-- Logs begin at Wed 2022-06-15 09:25:46 UTC, end at Wed 2022-06-15 10:36:26 UTC. -- Jun 15 10:04:54.645752 dv-cinder-830283-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 10:04:54.654362 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 10:04:54 2022] *** Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: nodename: dv-cinder-830283-5-iscsi Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: machine: x86_64 Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: clock source: unix Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: pcre jit disabled Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: detected number of CPU cores: 4 Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: current working directory: / Jun 15 10:04:54.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: detected binary path: /usr/bin/uwsgi-core Jun 15 10:04:54.657166 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: your processes number limit is 47680 Jun 15 10:04:54.657166 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: your memory page size is 4096 bytes Jun 15 10:04:54.657166 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: detected max file descriptor number: 2048 Jun 15 10:04:54.657166 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: lock engine: pthread robust mutexes Jun 15 10:04:54.657166 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: thunder lock: enabled Jun 15 10:04:54.657166 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 10:04:54.657166 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 10:04:54.701770 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: Python main interpreter initialized at 0x55720b35b9c0 Jun 15 10:04:54.701770 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: python threads support enabled Jun 15 10:04:54.701770 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: your server socket listen backlog is limited to 100 connections Jun 15 10:04:54.701770 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: your mercy for graceful operations on workers is 90 seconds Jun 15 10:04:54.702106 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 10:04:54.702182 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: *** Operational MODE: preforking *** Jun 15 10:04:54.702454 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: *** uWSGI is running in multiple interpreter mode *** Jun 15 10:04:54.702454 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: spawned uWSGI master process (pid: 103332) Jun 15 10:04:54.702652 dv-cinder-830283-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 10:04:54.706298 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: spawned uWSGI worker 1 (pid: 103333, cores: 1) Jun 15 10:04:54.706298 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: spawned uWSGI worker 2 (pid: 103334, cores: 1) Jun 15 10:04:54.706298 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 10:04:55.358818 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:04:55.361778 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:04:56.543438 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:04:56.543438 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: from cryptography.utils import int_from_bytes Jun 15 10:04:56.544128 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:04:56.544128 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: from cryptography.utils import int_from_bytes Jun 15 10:04:56.544248 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:04:56.544248 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: from cryptography.utils import int_from_bytes Jun 15 10:04:56.544248 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:04:56.544248 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: from cryptography.utils import int_from_bytes Jun 15 10:04:59.148043 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:04:59.148983 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:04:59.149346 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:04:59.149708 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:04:59.149920 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:04:59.150314 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:04:59.150400 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:04:59.150495 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.150696 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.150795 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:04:59.151023 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.151118 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:04:59.151317 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:04:59.151410 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.151665 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.151759 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.151981 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.152067 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.152304 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.152388 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.152625 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.152718 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.152958 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.153043 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.153222 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.153306 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.153540 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.153627 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.153868 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830283-5-iscsi {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.153958 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.154193 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.154302 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.154484 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.154570 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.154806 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.154892 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.155136 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830283-5-iscsi {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.155221 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.155446 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.155530 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.155764 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.155856 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.156070 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.156215 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.156388 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.156572 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.156700 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.157013 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.157127 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.157327 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.157446 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.157638 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.157831 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.158030 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.158180 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.158262 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.158472 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.158599 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.158789 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.158923 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.159129 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.159238 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.159450 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.159547 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.159760 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.159845 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.160082 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.160212 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830283-5-iscsi {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.160395 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.160534 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.160726 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.160862 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.161043 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.161137 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.161441 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830283-5-iscsi {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.161556 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.161761 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.161976 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.162071 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.162164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.162407 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.162509 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.162827 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.162921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.163136 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.163220 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.163448 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.163533 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.163773 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.164464 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.164651 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.164740 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.165007 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.165092 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.165316 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.165414 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.165628 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.165713 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.165942 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.166037 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.166285 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.166374 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.166605 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.166705 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.166916 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.167001 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.167171 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.167257 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.167483 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.167568 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.167810 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.167914 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.168133 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.168228 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.168386 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.168518 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.168700 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.168796 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.168951 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.169036 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.169274 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.169371 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.169598 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.169718 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.169892 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.169985 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.170148 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.170242 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.170504 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.170594 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.170830 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.170913 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.171139 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.171224 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.171449 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.171544 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.171757 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.171842 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.172065 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.172158 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.172375 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.172471 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.172688 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.172785 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.172999 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.173103 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.173308 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.173398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.173629 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.173713 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.173955 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.174124 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.174279 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.174366 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.174597 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.174696 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.174921 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.175017 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.175247 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.175346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.175558 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.175644 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.175869 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.175962 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.176195 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.176316 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.176505 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.176601 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.176815 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.176908 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.177126 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.177212 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.177447 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.177531 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.177760 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.177899 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.178071 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.178157 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.178357 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.178446 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.178665 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.178759 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.178973 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.179059 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.179294 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.179384 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.179627 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.179762 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.179937 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.180043 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.180244 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.180338 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.180552 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.180658 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.180861 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.180965 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.181169 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.181272 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.181477 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.181570 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.181782 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.181873 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.182086 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.182186 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.182418 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.182522 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.182727 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.182819 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.183033 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.183142 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.183339 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.183431 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.183646 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.183736 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.183959 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.184051 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.184264 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.184354 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.184573 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.184664 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.184877 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.184968 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.185183 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.185275 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.185501 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.185591 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.185807 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.185896 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.186114 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.186214 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.186442 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.186552 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.186757 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.186858 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.187063 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.187151 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.187370 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.187470 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.187677 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.187763 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.187984 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.188083 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.188291 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.188377 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.188592 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.188680 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.188899 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.188983 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.189207 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.189291 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.189512 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.189597 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.189819 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.189921 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.190121 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.190207 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.190452 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.190540 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.190758 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.190855 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.191062 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.191156 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.191368 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.191452 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.191673 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.191756 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.191975 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.192069 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.192284 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.192375 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.192594 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.192691 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.192902 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.193001 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.193205 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.193289 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.193509 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.193592 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.193830 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.193924 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.194140 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.194224 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.194482 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.194582 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.194795 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.194882 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.195643 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:04:59.195761 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.195986 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.196273 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.196373 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.196622 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.196707 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.196955 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.197041 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.197276 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.197374 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.197597 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.197683 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.197923 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.198006 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.198240 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.198384 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.198582 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.198668 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.198896 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.198981 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.199223 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.199308 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.199542 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.199628 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.199864 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.199974 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.200188 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.200296 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.200509 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.200595 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.200832 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.200925 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.201146 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.201239 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.201468 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.201552 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.201793 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.201879 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.202109 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.202202 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.202452 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.202537 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.202787 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.202873 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.203113 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.203200 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.203433 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.203529 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.203759 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.203843 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.204083 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.204170 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.204399 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.204484 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.204715 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.204813 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.205028 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.205115 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.205348 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.205431 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.205665 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.205764 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.205983 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.206075 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.206331 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.206444 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.206656 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.206757 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.206983 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.207072 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.207289 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.207382 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.207604 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.207698 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.207916 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.208000 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.208228 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.208312 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.208544 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.208639 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.208861 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.208952 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.209175 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.209260 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.209495 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.209581 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.209807 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.209892 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.210122 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.210210 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.210463 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.210551 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.211322 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.211416 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.211653 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.211934 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.212029 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.212257 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.212356 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.212570 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.212654 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.212883 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.212979 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.213196 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.213281 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.213508 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.213594 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.213826 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.213917 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.214154 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.214246 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.214491 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.214578 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.214807 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.214894 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.215122 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.215207 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.215437 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.215530 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.215749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.215842 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.216067 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.216159 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.216382 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.216468 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.216692 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.216786 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.217006 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.217090 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.217319 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.217413 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.217625 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.217711 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.217950 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.218035 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.218260 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.218406 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.218595 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.218682 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.218908 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.219002 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.219221 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.219314 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.219538 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.219624 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.219852 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.219936 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.220164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.220259 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.220479 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.220563 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.220795 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.220889 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.221108 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.221193 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.221433 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.221518 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.222028 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.222128 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.222366 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.222455 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.222701 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.222788 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.223022 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.223105 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.223342 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.223427 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.223650 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.223743 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.223964 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.224057 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.224273 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.224359 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.224581 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.224666 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.224888 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.224982 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.225199 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.225285 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.225505 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.225588 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.225813 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.225980 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.226124 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.226208 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.226498 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.226590 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.226813 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.226987 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.227162 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.227306 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.227450 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.227620 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.227760 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.227952 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.228067 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.228270 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.228364 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.228583 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.228711 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.228893 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.229022 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.229204 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.229367 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.229553 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.229706 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.229865 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.230030 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.230213 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.230394 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.230579 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.230715 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.230911 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.231037 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.231242 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.231354 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.231560 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.231675 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.231880 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.231991 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.232198 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.232307 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.232517 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.232632 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.232834 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.232952 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.233151 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.233278 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.233477 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.233594 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.233794 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.233923 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.234117 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.234236 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.234467 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.234584 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.234797 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.234883 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.235115 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.235201 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.235440 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.235527 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.235751 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.235838 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.236072 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.236166 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.236417 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.236504 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.236757 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.236843 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.237082 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.237176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.237393 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.237477 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.237711 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.237807 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.238027 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.238130 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.238366 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.238470 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.238687 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.238772 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.238999 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.239096 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.239316 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.239400 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.239626 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.239710 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.239949 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.240041 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.240260 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.240387 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.240579 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.240665 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.240884 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.240969 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.241200 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.241287 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.241529 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.241613 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.241842 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.241929 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.242190 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.242325 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.242535 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.242716 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.242861 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.243060 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.243175 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.243378 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.243488 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.243699 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.243793 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.244028 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.244113 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.244347 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.244434 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.244665 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.244762 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.244984 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.245070 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.245294 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.245378 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.245604 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.245689 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.245912 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.245995 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.246230 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.246523 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.246657 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.246770 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.246865 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.246946 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.247158 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.247245 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.247471 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.247558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.247785 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.247869 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.248097 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.248189 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.248405 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.248490 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.248721 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.248816 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.249026 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.249161 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.249335 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.249430 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.249658 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.249743 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.249969 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.250065 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.250312 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.250437 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.250606 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.250693 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.250912 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.251008 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.251240 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.251324 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.251550 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.251648 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.251853 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.251945 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.252162 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.252259 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.252486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.252570 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.252799 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.252885 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.253111 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.253196 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.253423 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.253507 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.253738 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.253833 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.254051 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.254144 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.254393 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.254481 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.254709 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.254798 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.255025 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.255111 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.255349 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.255511 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.255658 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.255744 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.255971 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.256062 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.256292 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.256387 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.256608 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.256692 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.256925 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.257010 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.257241 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.257338 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.258069 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.258219 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.258413 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.258554 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.258821 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.258985 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.259166 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.259401 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.259547 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.259744 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.259903 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.260072 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.260219 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.260399 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.260656 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.260807 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.261001 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.261142 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.261323 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.261464 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.261651 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.261799 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.261982 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.262143 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.262348 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.262511 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.262657 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.262808 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.262953 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.263109 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.263271 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.263369 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.263542 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.263638 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.263855 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.263940 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.264168 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.264254 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.264482 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.265651 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.265746 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.265834 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.265922 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266002 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266080 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266157 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266241 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266345 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266443 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266443 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266595 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266679 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266912 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.266998 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.267220 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.267803 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.267905 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.267982 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.268057 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.268145 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.268213 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.268423 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.268510 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.268728 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.268854 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.269053 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.269149 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.269370 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.269454 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.269702 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.269785 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.270024 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.270110 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.271701 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.271806 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.271890 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.271992 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272075 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272160 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272247 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272334 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272334 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272485 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272573 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272662 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272827 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272904 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.272904 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.273054 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.273132 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.273993 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.274150 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.274387 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.274706 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.274793 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.275021 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.275330 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.276912 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277021 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277168 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277250 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277328 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277405 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277483 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277569 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277646 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277711 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277775 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277851 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.277928 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278014 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278100 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278179 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278256 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278351 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278428 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278519 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278600 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278677 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.278864 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.279005 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.279185 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.279273 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.279498 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.279584 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.279819 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.279905 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.280131 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.280218 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.280443 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.280537 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.280749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.280836 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.281071 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.281157 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.281383 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.281468 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.281692 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.281779 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.282000 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.282088 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.282334 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.282426 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.282642 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.282741 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.282947 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.283033 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.283259 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.283350 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.283572 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.283668 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.283891 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.283983 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.284197 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.284281 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.284508 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.284605 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.284816 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.284900 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.285124 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.285210 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.285433 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.285532 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.285742 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.285827 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.286047 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.286132 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.286378 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.286466 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.286691 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.286777 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.286995 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.287078 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.287301 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.287388 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.287627 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.287713 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.287936 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.288020 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.288239 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.288326 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.288546 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.288633 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.288885 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.288975 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.289200 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.289287 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.289518 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.289604 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.289831 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.289930 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.290142 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.290235 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.290482 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.290575 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.290797 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.290897 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.291111 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.291197 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.291434 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.291518 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.291746 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.291840 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.292052 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.292136 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.292360 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.292452 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.292668 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.292762 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.292982 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.293073 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.293292 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.293378 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.293598 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.293685 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.293921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.294007 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.294236 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.294351 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.294575 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.294670 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.294902 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.294989 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.295224 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.295308 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.295545 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.295632 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.295851 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.295935 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.296162 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.296255 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.296480 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.296566 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.296789 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.296881 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.297098 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.297189 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.297405 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.297493 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.297718 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.297804 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.298032 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.298131 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.298368 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.298459 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.298688 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.298774 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.299001 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.299100 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.299312 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.299401 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.299625 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.299711 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.299937 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.300032 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.300246 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.300332 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.300558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.300649 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.300871 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.301003 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.301179 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.301264 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.301490 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.301574 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.301797 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.301883 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.302110 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.302195 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.302445 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.302534 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.302763 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.302879 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.303077 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.303196 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.303393 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.303514 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.303710 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.303825 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.304023 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.304141 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.304355 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.304523 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.304698 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.304899 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.305149 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.305234 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.305470 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.305569 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.305784 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.305926 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.306103 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.306242 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.306442 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.306599 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.306883 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.306968 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.307204 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.307290 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.307513 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.307610 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.307825 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.307909 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.308143 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.308229 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.308450 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.308547 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.308760 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.308853 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.309066 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.309151 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.309377 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.309462 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.309690 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.309819 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.310018 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.310105 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.310440 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.310541 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.310760 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.310847 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.311068 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.311151 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.311379 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.311488 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.311695 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.311803 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.312026 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.312113 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.312338 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.312469 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.312649 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.312735 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.312960 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.313056 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.313289 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.313375 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.313601 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.313688 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.313930 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.314024 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.314260 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.314372 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.314612 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.314699 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.314928 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.315022 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.315246 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.315391 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.315554 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.315710 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.315879 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.316029 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.316206 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.316358 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.316530 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.316683 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.316854 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.317011 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.317271 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.317367 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.317599 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.317685 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.317913 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.318006 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.318239 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.318372 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.318592 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.318679 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.318906 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.318993 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.319219 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.319306 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.319530 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.319617 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.319836 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.319921 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.320656 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.320983 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.321078 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.321294 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.321378 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.321610 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.321710 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.321924 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.322052 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.322236 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.322411 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.322576 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.322734 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.322863 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.323066 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.323196 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.323400 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.323497 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.323717 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.323803 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.324032 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.324124 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.324351 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.324446 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.324666 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.324760 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.324978 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.325074 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.325307 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.325403 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.325620 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.325706 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.325925 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.326009 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.326239 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.326375 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.326571 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.326668 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.326882 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.326967 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.327195 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.327298 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.327523 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.327619 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.327833 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.327928 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.328162 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.328257 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.328478 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.328570 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.328803 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.328888 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.329131 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.329227 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.329444 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.329580 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.329765 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.329865 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.330079 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.330166 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.330414 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.330502 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.330725 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.330828 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.331037 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.331123 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.331343 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.331436 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.331653 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.331749 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.331964 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.332050 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.332280 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.332366 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.332590 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.332684 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.332902 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.332995 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.333211 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.333305 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.333538 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.333626 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.333848 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.333933 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.334176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.334261 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.334515 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.334609 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.334823 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.334909 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.335134 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.335227 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.335443 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.335538 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.336463 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.336556 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.336796 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.337049 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.337148 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.337524 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.337609 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.337865 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.338005 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.338178 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.338286 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.338519 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.338618 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.338854 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.338941 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.339171 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.339260 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.339499 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.339584 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.339815 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.339900 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.340129 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.340218 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.340445 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.340540 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.340758 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.340844 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.341078 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.341165 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.341402 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.341497 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.341720 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.341815 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.342044 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.342137 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.342406 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.342497 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.342748 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.342846 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.343069 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.343308 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.343395 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.343647 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.343734 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.343970 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.344073 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.344291 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.344378 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.344611 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.344699 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.344931 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.345018 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.345252 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.345344 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.345570 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.345665 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.345887 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.345972 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.346201 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.346305 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.346549 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.346913 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.347145 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.347239 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.347472 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.347688 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.347803 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.348027 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.348146 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.348350 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.348474 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.348671 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.348767 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.348990 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.349077 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.349313 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.349406 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.349634 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.349729 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.349952 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.350040 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.350311 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.350413 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.350607 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.350696 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.350923 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.351010 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.351258 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.351352 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.352104 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.352223 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.352443 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.352566 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.352825 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.352912 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.353149 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.353244 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.353470 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.353556 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.353789 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.353953 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.354108 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.354195 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.354464 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.354551 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.354795 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.354899 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.355136 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.355223 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.355457 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.355542 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.355775 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.355860 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.356093 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.356177 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.356413 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.356500 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.356734 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.356937 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.357054 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.357261 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.357376 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.357602 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.357700 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.357935 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.358021 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.358291 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.358381 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.358611 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.358708 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.358932 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.359026 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.359265 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.359358 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.359578 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.359666 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.359889 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.359982 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.360203 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.360337 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.360519 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.360613 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.360828 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.361040 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.361152 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.361363 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.361458 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.361704 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.361791 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.362042 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.362136 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.362396 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.362502 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.362721 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.362935 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.363048 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.363285 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.363380 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.363606 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.363699 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.363937 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.364061 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.364268 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.364364 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.364586 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.364671 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.364944 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.365036 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.365223 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.365318 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.365530 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.365622 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.365839 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.365924 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.366157 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.366250 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.366497 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.366582 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.366805 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.367653 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.367854 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.368026 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.368227 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.368371 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.368520 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.368712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.368834 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.369050 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.369137 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.369378 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.369466 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.369695 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.369796 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.370027 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.370115 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.370366 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.370467 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.370683 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.370779 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.370998 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.371084 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.371308 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.371397 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.371618 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.371706 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.371929 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.372015 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.372240 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.372348 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.372552 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.372640 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.372862 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.372948 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.373174 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.373259 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.373482 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.373568 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.373796 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.373881 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.374107 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.374202 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.374445 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.374532 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.374761 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.374849 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.375082 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.375186 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.375396 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.375490 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.375708 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.375794 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.376020 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.376119 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.376332 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.376420 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.376650 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.376736 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.376962 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.377056 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.377275 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.377368 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.377587 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.377674 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.377908 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.378005 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.378219 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.378521 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.378608 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.378865 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.378968 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.379191 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.379278 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.379520 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.379605 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.379832 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.379927 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.380155 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.380242 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.380467 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.380551 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.380780 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.380881 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.381102 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.381190 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.381416 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.381501 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.381733 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.381829 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.382051 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.382139 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.382409 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.382764 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.382939 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.383057 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.383143 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.383373 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.383460 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.383687 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.383787 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.384005 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.384092 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.384317 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.384403 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.384631 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.384796 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.384944 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.385031 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.385259 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.385353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.385577 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.385663 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.385896 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.385984 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.386216 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.386321 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.386560 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.386648 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.386878 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.386964 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.387194 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.387280 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.387508 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.387594 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.387823 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.387908 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.388134 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.388235 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.388449 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.388535 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.388765 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.388893 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.389081 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.389176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.389396 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.389491 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.389701 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.389785 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.390051 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.390145 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.390405 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.390496 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.390733 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.390819 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.391056 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.391144 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.391372 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.391457 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.391687 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.391785 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.392010 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.392096 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.392325 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.392425 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.392643 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.392747 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.392952 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.393037 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.393283 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.393369 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.393601 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.393696 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.393912 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.393999 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.394253 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.394396 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.394587 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.394691 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.394897 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.394984 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.395207 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.395293 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.395521 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.395617 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.395840 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.395927 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.396152 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.396238 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.396465 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.396561 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.396774 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.396861 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.397086 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.397172 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.397393 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.397484 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.397700 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.397786 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.398009 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.398139 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.398505 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.398596 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.398822 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.398910 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.399136 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.399222 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.399446 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.399540 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.399757 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.399850 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.400066 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.400162 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.400376 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.400462 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.400684 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.400770 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.400994 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.401087 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.401299 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.401384 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.401606 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.401691 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.401915 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.402008 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.402221 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.402321 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.402555 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.402653 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.402873 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.402983 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.403182 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.403269 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.403493 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.403579 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.403804 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.403892 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.404115 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.404202 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.404425 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.404510 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.404736 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.404834 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.405051 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.405137 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.405360 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.405446 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.405672 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.405759 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.405981 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.406074 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.406351 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.406453 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.406660 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.406747 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.406981 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.407068 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.407300 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.407395 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.407618 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.407706 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.407932 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.408019 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.408250 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.408353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.408578 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.408663 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.408897 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.408983 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.409209 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.409305 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.409539 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.409623 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.409858 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.409942 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.410173 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.410317 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.410521 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.410607 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.410840 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.410933 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.411159 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.411245 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.411478 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.411563 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.411794 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.411879 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.412117 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.412210 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.412431 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.412524 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.412749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.412854 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.413074 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.413163 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.413387 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.413471 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.413718 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.414421 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.414580 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.414675 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.414978 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.415064 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.415313 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.415410 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.415646 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.415732 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.415999 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.416087 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.416320 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.416419 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.416645 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.416731 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.416971 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.417059 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.417292 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.417392 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.417609 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.417693 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.417921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.418015 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.418170 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:04:59.418258 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.418592 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.418930 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.419249 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.419585 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.419921 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.420276 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.420599 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.420950 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.421288 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.421614 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.421936 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.422252 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:04:59.422532 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:04:59.480292 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO dbcounter [None req-86150948-2645-44a2-a944-477313ed54cd None None] Registered counter for database nova_api Jun 15 10:04:59.485123 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO dbcounter [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Registered counter for database nova_api Jun 15 10:04:59.501115 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG oslo_db.sqlalchemy.engines [None req-86150948-2645-44a2-a944-477313ed54cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:04:59.505187 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:04:59.507868 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writer thread running {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:04:59.511768 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writer thread running {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:04:59.566779 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.context [None req-86150948-2645-44a2-a944-477313ed54cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8150241a-a1e8-4d3b-89e1-e7326b204d0a(cell1) {{(pid=103333) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:04:59.569423 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.context [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8150241a-a1e8-4d3b-89e1-e7326b204d0a(cell1) {{(pid=103334) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:04:59.571084 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG oslo_concurrency.lockutils [None req-86150948-2645-44a2-a944-477313ed54cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:04:59.572705 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG oslo_concurrency.lockutils [None req-86150948-2645-44a2-a944-477313ed54cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:04:59.573515 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG oslo_concurrency.lockutils [None req-86150948-2645-44a2-a944-477313ed54cd None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:04:59.573608 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:04:59.575226 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:04:59.575531 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG oslo_concurrency.lockutils [None req-86150948-2645-44a2-a944-477313ed54cd None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:04:59.576045 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:04:59.577469 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO dbcounter [None req-86150948-2645-44a2-a944-477313ed54cd None None] Registered counter for database nova_cell0 Jun 15 10:04:59.578051 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:04:59.580034 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO dbcounter [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Registered counter for database nova_cell0 Jun 15 10:04:59.581286 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO dbcounter [None req-86150948-2645-44a2-a944-477313ed54cd None None] Registered counter for database nova_cell1 Jun 15 10:04:59.583806 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO dbcounter [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Registered counter for database nova_cell1 Jun 15 10:04:59.591087 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG oslo_db.sqlalchemy.engines [None req-86150948-2645-44a2-a944-477313ed54cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:04:59.591849 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG oslo_db.sqlalchemy.engines [None req-86150948-2645-44a2-a944-477313ed54cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:04:59.594339 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:04:59.595652 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:04:59.598760 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writer thread running {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:04:59.603399 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writer thread running {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:04:59.604687 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writer thread running {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:04:59.605056 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writer thread running {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:04:59.747383 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO dbcounter [None req-86150948-2645-44a2-a944-477313ed54cd None None] Registered counter for database nova_cell0 Jun 15 10:04:59.752150 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO dbcounter [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Registered counter for database nova_cell0 Jun 15 10:04:59.754043 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG oslo_db.sqlalchemy.engines [None req-86150948-2645-44a2-a944-477313ed54cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:04:59.758515 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writer thread running {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:04:59.761123 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:04:59.765422 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writer thread running {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:05:00.104199 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: WARNING keystonemiddleware.auth_token [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:05:00.111410 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: WARNING keystonemiddleware.auth_token [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:05:00.115337 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: WARNING keystonemiddleware.auth_token [None req-86150948-2645-44a2-a944-477313ed54cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:05:00.123044 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: WARNING keystonemiddleware.auth_token [None req-86150948-2645-44a2-a944-477313ed54cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:05:00.463554 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: WARNING keystonemiddleware.auth_token [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:05:00.469608 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: WARNING keystonemiddleware.auth_token [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:05:00.475176 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55720b35b9c0 pid: 103334 (default app) Jun 15 10:05:00.477363 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:05:00.478591 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001787 Jun 15 10:05:00.479010 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Wed Jun 15 10:05:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:05:00.481010 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: WARNING keystonemiddleware.auth_token [None req-86150948-2645-44a2-a944-477313ed54cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:05:00.487037 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: WARNING keystonemiddleware.auth_token [None req-86150948-2645-44a2-a944-477313ed54cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:05:00.493456 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55720b35b9c0 pid: 103333 (default app) Jun 15 10:06:17.015907 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:17.016975 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 15 10:06:17.017376 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:17.030745 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_api:SELECT=3 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:06:17.031890 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_cell0:SELECT=3 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:06:17.032772 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_cell1:SELECT=3 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:06:17.034780 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:06:17.485051 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-d6fcd524-e18f-45a8-b3db-e9f383b76b68 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:17.515776 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-d6fcd524-e18f-45a8-b3db-e9f383b76b68 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490122 Jun 15 10:06:17.516325 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Jun 15 10:06:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:06:19.726218 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:19.727399 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-b4c028d5-ff75-4a01-b219-29e4e5596ca0 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Jun 15 10:06:19.727829 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:19.796975 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7eb33d1a-8feb-499a-a441-77fc1bdb2d1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:19.816534 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:06:19.816534 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: warnings.warn(msg) Jun 15 10:06:19.849565 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-7eb33d1a-8feb-499a-a441-77fc1bdb2d1d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114726 Jun 15 10:06:19.852078 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:06:20.076574 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-4da43afe-3216-4def-aa39-f2d9cd327500 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:20.077960 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:06:20.077960 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jun 15 10:06:20.081418 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=3 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:06:20.082513 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell1:SELECT=3 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:06:20.083312 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell0:SELECT=3 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:06:20.084030 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:06:20.148190 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-4da43afe-3216-4def-aa39-f2d9cd327500 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289362 Jun 15 10:06:20.149027 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 10:06:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:06:22.364514 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-7eb33d1a-8feb-499a-a441-77fc1bdb2d1d admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:22.365534 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-7eb33d1a-8feb-499a-a441-77fc1bdb2d1d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 15 10:06:22.366152 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:22.494106 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-cb9bcaf5-f01d-4c5a-bb6a-9ee017589d6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:22.511993 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:06:22.511993 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jun 15 10:06:22.531978 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-cb9bcaf5-f01d-4c5a-bb6a-9ee017589d6d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160241 Jun 15 10:06:22.532544 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:06:22.545476 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-5ba2c421-88a2-41bb-9e46-a47db85baf38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:22.547041 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:06:22.547041 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: warnings.warn(msg) Jun 15 10:06:22.595764 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-5ba2c421-88a2-41bb-9e46-a47db85baf38 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054861 Jun 15 10:06:22.596382 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 10:06:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:06:24.829264 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-cb9bcaf5-f01d-4c5a-bb6a-9ee017589d6d admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:24.830353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-cb9bcaf5-f01d-4c5a-bb6a-9ee017589d6d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 15 10:06:24.830756 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:24.891180 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-e472dd54-fe59-4d09-bda8-171bffee02a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:24.910517 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-e472dd54-fe59-4d09-bda8-171bffee02a8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073365 Jun 15 10:06:24.911243 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:06:24.922781 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-01d4b7d1-a31a-4a43-8412-8cffddfa203a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:24.947732 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-01d4b7d1-a31a-4a43-8412-8cffddfa203a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028523 Jun 15 10:06:24.948319 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 10:06:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:06:27.169928 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-e472dd54-fe59-4d09-bda8-171bffee02a8 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:27.170981 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-e472dd54-fe59-4d09-bda8-171bffee02a8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 15 10:06:27.171470 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:27.235081 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-814bc873-3020-42d5-ba09-7a38852b9d18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2, "name": "ds2G", "id": "d3", "swap": 0}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:27.258918 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-814bc873-3020-42d5-ba09-7a38852b9d18 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080146 Jun 15 10:06:27.259476 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:06:27.273045 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-c94d5805-3345-4ebf-842d-d0a1236ec909 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:27.301877 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-c94d5805-3345-4ebf-842d-d0a1236ec909 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033920 Jun 15 10:06:27.308683 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 10:06:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:06:29.542096 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-814bc873-3020-42d5-ba09-7a38852b9d18 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:29.543113 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-814bc873-3020-42d5-ba09-7a38852b9d18 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 15 10:06:29.543701 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:29.604508 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-66045d3f-2f44-455c-997d-fc751673b807 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:29.625482 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-66045d3f-2f44-455c-997d-fc751673b807 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075669 Jun 15 10:06:29.626449 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:06:29.638460 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-51e28a11-cdfc-4a13-8316-888c27a21739 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:29.664478 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-51e28a11-cdfc-4a13-8316-888c27a21739 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029627 Jun 15 10:06:29.665194 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Wed Jun 15 10:06:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:06:31.850693 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-66045d3f-2f44-455c-997d-fc751673b807 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:31.851704 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-66045d3f-2f44-455c-997d-fc751673b807 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 15 10:06:31.854650 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:31.915863 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-cbfc2a21-d984-4e6b-bd56-bee11babc55f admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:31.940462 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-cbfc2a21-d984-4e6b-bd56-bee11babc55f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081724 Jun 15 10:06:31.941857 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Jun 15 10:06:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:06:34.167214 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-66045d3f-2f44-455c-997d-fc751673b807 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:34.168789 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-66045d3f-2f44-455c-997d-fc751673b807 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001896 Jun 15 10:06:34.169209 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:34.231072 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-152df08a-a25e-4de5-b5b1-f5902e360ed2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:34.248985 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-152df08a-a25e-4de5-b5b1-f5902e360ed2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074004 Jun 15 10:06:34.249557 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:06:34.261609 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-bede9066-9dd1-4d09-8136-c9604be753bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:34.285782 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-bede9066-9dd1-4d09-8136-c9604be753bb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027340 Jun 15 10:06:34.294465 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 10:06:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:06:36.540228 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-152df08a-a25e-4de5-b5b1-f5902e360ed2 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:36.541337 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-152df08a-a25e-4de5-b5b1-f5902e360ed2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 15 10:06:36.541750 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:06:36.603273 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-59973f71-41cf-40c8-9f7e-6eeb7f0767af admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:36.622308 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-59973f71-41cf-40c8-9f7e-6eeb7f0767af admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074240 Jun 15 10:06:36.622893 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:06:36.637184 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-3506a5fb-bacd-49e1-a2cc-899e77e9a288 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:36.662258 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-3506a5fb-bacd-49e1-a2cc-899e77e9a288 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030105 Jun 15 10:06:36.662885 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 10:06:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:06:38.927928 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-59973f71-41cf-40c8-9f7e-6eeb7f0767af admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:38.928939 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-59973f71-41cf-40c8-9f7e-6eeb7f0767af admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 15 10:06:38.929341 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:39.003891 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-8bd33530-a0cf-4f4f-b199-7bb197eb28b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:39.026380 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-8bd33530-a0cf-4f4f-b199-7bb197eb28b9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.089498 Jun 15 10:06:39.027097 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:06:39.040759 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-bfe1facd-207f-4cc9-b76c-412132bdfa70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:39.063554 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-bfe1facd-207f-4cc9-b76c-412132bdfa70 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026517 Jun 15 10:06:39.064122 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 10:06:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:06:41.241463 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-8bd33530-a0cf-4f4f-b199-7bb197eb28b9 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:41.242521 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-8bd33530-a0cf-4f4f-b199-7bb197eb28b9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 15 10:06:41.242928 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:41.304698 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-5704f0bf-dcd8-405a-ba3b-c2eb520dcec3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:41.323912 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-5704f0bf-dcd8-405a-ba3b-c2eb520dcec3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075183 Jun 15 10:06:41.324450 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:06:41.338526 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-eae79f8d-ae5f-4de0-b319-bb5138be5b3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:41.361993 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-eae79f8d-ae5f-4de0-b319-bb5138be5b3c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029426 Jun 15 10:06:41.362628 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 10:06:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:06:43.552647 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-5704f0bf-dcd8-405a-ba3b-c2eb520dcec3 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:06:43.553659 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-5704f0bf-dcd8-405a-ba3b-c2eb520dcec3 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 15 10:06:43.554063 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:06:43.615601 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-b2fe9fd3-9883-4d9c-9ed9-34805eddd3ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:43.634361 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-b2fe9fd3-9883-4d9c-9ed9-34805eddd3ca admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074501 Jun 15 10:06:43.635499 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Wed Jun 15 10:06:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:06:43.647643 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f1285272-c166-4cba-88b6-810f7e5b8bd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:06:43.676526 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f1285272-c166-4cba-88b6-810f7e5b8bd3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033072 Jun 15 10:06:43.677696 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Wed Jun 15 10:06:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:07:08.684287 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-b2fe9fd3-9883-4d9c-9ed9-34805eddd3ca admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:08.685605 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-b2fe9fd3-9883-4d9c-9ed9-34805eddd3ca admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001769 Jun 15 10:07:08.686099 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:08.697289 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:07:08.745133 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-1c8b3b36-4d75-400f-a7c3-2bab775450f7 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:08.762680 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-1c8b3b36-4d75-400f-a7c3-2bab775450f7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070698 Jun 15 10:07:08.763210 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Jun 15 10:07:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:07:09.733376 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-b2fe9fd3-9883-4d9c-9ed9-34805eddd3ca admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:09.734386 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-b2fe9fd3-9883-4d9c-9ed9-34805eddd3ca admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Jun 15 10:07:09.734775 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:09.924038 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-bd035cb5-cac1-4556-971d-89efcf8c4a27 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:09.931181 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.wsgi [None req-bd035cb5-cac1-4556-971d-89efcf8c4a27 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-bd035cb5-cac1-4556-971d-89efcf8c4a27 admin admin] Request method failure captured: Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Accept: application/json Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Accept-Encoding: gzip, deflate Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Connection: keep-alive Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Content-Length: 0 Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Host: 10.222.0.57 Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Openstack-Api-Version: compute 2.90 Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Openstack-System-Scope: None Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: User-Agent: python-novaclient Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Auth-Token: gAAAAABiqa9NlgwUfpZgvv6PDa5q3EItfV-X3KiuW7whbxQUFJH4Rp32BGrUz7Vnmy1ntZlcYd2lRW8yuKnL1qpa0PbwNbPmdHdxPVV82f7Xz3RD0nCVspxEB2_GYmMgoJ-T70DHLfJcsWxxOIlQiBE_crX0WhjBGFTGqYoGmR8T00HpfjUsYkQ Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Domain-Id: None Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Domain-Name: None Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Identity-Status: Confirmed Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Is-Admin-Project: True Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Domain-Id: default Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Domain-Name: Default Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Name: admin Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Role: member,reader,admin Jun 15 10:07:09.934486 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Roles: member,reader,admin Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5ca5bc2dcee64d0eb4fea80b38a3107c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant: admin Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant-Name: admin Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User: admin Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Domain-Id: default Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Domain-Name: Default Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Id: cb3264418d25466c8226592c04529c8a Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Name: admin Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: method: > Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: exception: Flavor 42 could not be found. Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: action_args: {'id': '42'} Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:07:09.936112 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:09.937095 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:09.938564 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-bd035cb5-cac1-4556-971d-89efcf8c4a27 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:07:09.940107 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-bd035cb5-cac1-4556-971d-89efcf8c4a27 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061920 Jun 15 10:07:09.940107 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Jun 15 10:07:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 10:07:09.946816 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-65b5515e-f76a-4841-922c-2024e3354537 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:09.949593 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:07:09.973438 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-65b5515e-f76a-4841-922c-2024e3354537 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031359 Jun 15 10:07:09.974010 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 10:07:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:07:09.985503 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-88fd6cf8-6cfb-4947-8c46-18c6187e3dc6 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:10.010782 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-88fd6cf8-6cfb-4947-8c46-18c6187e3dc6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029911 Jun 15 10:07:10.011340 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 10:07:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:07:10.020952 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-3f13f1af-5d8f-4caa-873f-b49bfbc3c6e0 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:10.027672 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.wsgi [None req-3f13f1af-5d8f-4caa-873f-b49bfbc3c6e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-3f13f1af-5d8f-4caa-873f-b49bfbc3c6e0 admin admin] Request method failure captured: Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Accept: application/json Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Accept-Encoding: gzip, deflate Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Connection: keep-alive Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Content-Length: 0 Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Host: 10.222.0.57 Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Openstack-Api-Version: compute 2.90 Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Openstack-System-Scope: None Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: User-Agent: python-novaclient Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Auth-Token: gAAAAABiqa9NlgwUfpZgvv6PDa5q3EItfV-X3KiuW7whbxQUFJH4Rp32BGrUz7Vnmy1ntZlcYd2lRW8yuKnL1qpa0PbwNbPmdHdxPVV82f7Xz3RD0nCVspxEB2_GYmMgoJ-T70DHLfJcsWxxOIlQiBE_crX0WhjBGFTGqYoGmR8T00HpfjUsYkQ Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Domain-Id: None Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Domain-Name: None Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Identity-Status: Confirmed Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Is-Admin-Project: True Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Domain-Id: default Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Domain-Name: Default Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Name: admin Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Role: member,reader,admin Jun 15 10:07:10.030895 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Roles: member,reader,admin Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5ca5bc2dcee64d0eb4fea80b38a3107c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant: admin Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant-Name: admin Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User: admin Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Domain-Id: default Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Domain-Name: Default Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Id: cb3264418d25466c8226592c04529c8a Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Name: admin Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: method: > Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: exception: Flavor 42 could not be found. Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: action_args: {'id': '42'} Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:07:10.032398 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:10.033353 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:10.034631 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-3f13f1af-5d8f-4caa-873f-b49bfbc3c6e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:07:10.035824 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-3f13f1af-5d8f-4caa-873f-b49bfbc3c6e0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015165 Jun 15 10:07:10.035824 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Jun 15 10:07:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:07:10.906685 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-88fd6cf8-6cfb-4947-8c46-18c6187e3dc6 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:10.907705 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-88fd6cf8-6cfb-4947-8c46-18c6187e3dc6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 15 10:07:10.908105 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:07:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:11.102891 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-e9fb0238-79b7-47cf-8a2f-0e14bff31351 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:11.108819 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.wsgi [None req-e9fb0238-79b7-47cf-8a2f-0e14bff31351 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-e9fb0238-79b7-47cf-8a2f-0e14bff31351 admin admin] Request method failure captured: Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Accept: application/json Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Accept-Encoding: gzip, deflate Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Connection: keep-alive Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Content-Length: 0 Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Host: 10.222.0.57 Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Openstack-Api-Version: compute 2.90 Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Openstack-System-Scope: None Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: User-Agent: python-novaclient Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Auth-Token: gAAAAABiqa9OPlKWcLgE2N9dDjnH9UlocaPpC1DAtavt_NVg-vuCtB2qukxFhMwTO8xZhjm9iwkzUkRwY_2_-tv0Ky8Ms958rj5-GVeEOcMI19MD-Y90U5QwIH0GFV5pFOY0CrbKiFKXJZ5_p0jqwGv0mfts4cIFvJeovyR5lJeC8sa99z_9oxc Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Domain-Id: None Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Domain-Name: None Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Identity-Status: Confirmed Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Is-Admin-Project: True Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Domain-Id: default Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Domain-Name: Default Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Name: admin Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Role: member,reader,admin Jun 15 10:07:11.110336 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Roles: member,reader,admin Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5ca5bc2dcee64d0eb4fea80b38a3107c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant: admin Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant-Name: admin Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User: admin Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Domain-Id: default Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Domain-Name: Default Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Id: cb3264418d25466c8226592c04529c8a Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Name: admin Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: method: > Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: exception: Flavor 84 could not be found. Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: action_args: {'id': '84'} Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:07:11.111571 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:11.112346 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.113712 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-e9fb0238-79b7-47cf-8a2f-0e14bff31351 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:07:11.114794 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-e9fb0238-79b7-47cf-8a2f-0e14bff31351 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061648 Jun 15 10:07:11.114794 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Jun 15 10:07:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:07:11.122189 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-8f903ec0-87c1-4dfd-a1fa-558b2556e783 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:11.137810 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-8f903ec0-87c1-4dfd-a1fa-558b2556e783 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019192 Jun 15 10:07:11.138361 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 10:07:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:07:11.147715 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-3a5c2b37-6e1b-47c8-9fca-ceb69b991e75 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:11.161162 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-3a5c2b37-6e1b-47c8-9fca-ceb69b991e75 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016976 Jun 15 10:07:11.161678 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 10:07:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:07:11.171059 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-64e541a5-e751-4883-8b2e-7bb31e38448b admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:11.176260 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.wsgi [None req-64e541a5-e751-4883-8b2e-7bb31e38448b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-64e541a5-e751-4883-8b2e-7bb31e38448b admin admin] Request method failure captured: Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Accept: application/json Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Accept-Encoding: gzip, deflate Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Connection: keep-alive Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Content-Length: 0 Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Host: 10.222.0.57 Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Openstack-Api-Version: compute 2.90 Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Openstack-System-Scope: None Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: User-Agent: python-novaclient Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Auth-Token: gAAAAABiqa9OPlKWcLgE2N9dDjnH9UlocaPpC1DAtavt_NVg-vuCtB2qukxFhMwTO8xZhjm9iwkzUkRwY_2_-tv0Ky8Ms958rj5-GVeEOcMI19MD-Y90U5QwIH0GFV5pFOY0CrbKiFKXJZ5_p0jqwGv0mfts4cIFvJeovyR5lJeC8sa99z_9oxc Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Domain-Id: None Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Domain-Name: None Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Identity-Status: Confirmed Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Is-Admin-Project: True Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Domain-Id: default Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Domain-Name: Default Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Name: admin Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Role: member,reader,admin Jun 15 10:07:11.177749 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Roles: member,reader,admin Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5ca5bc2dcee64d0eb4fea80b38a3107c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant: admin Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant-Name: admin Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User: admin Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Domain-Id: default Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Domain-Name: Default Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Id: cb3264418d25466c8226592c04529c8a Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Name: admin Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: method: > Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: exception: Flavor 84 could not be found. Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: action_args: {'id': '84'} Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:07:11.179787 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:11.180553 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:11.181921 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-64e541a5-e751-4883-8b2e-7bb31e38448b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:07:11.183267 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-64e541a5-e751-4883-8b2e-7bb31e38448b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012531 Jun 15 10:07:11.183267 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Jun 15 10:07:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:07:12.055154 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-3a5c2b37-6e1b-47c8-9fca-ceb69b991e75 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:12.056155 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-3a5c2b37-6e1b-47c8-9fca-ceb69b991e75 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 15 10:07:12.056586 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:12.247407 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-75464ef7-f028-486a-b0de-a287da0dca9c admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:12.253169 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.wsgi [None req-75464ef7-f028-486a-b0de-a287da0dca9c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-75464ef7-f028-486a-b0de-a287da0dca9c admin admin] Request method failure captured: Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Accept: application/json Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Accept-Encoding: gzip, deflate Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Connection: keep-alive Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Content-Length: 0 Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Host: 10.222.0.57 Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Openstack-Api-Version: compute 2.90 Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Openstack-System-Scope: None Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: User-Agent: python-novaclient Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Auth-Token: gAAAAABiqa9Qo0CMExK4XwWXsyoSWdcik01gBvF9rrJun3taD0HJnwrZ5ZcuF4y5wwVgBcRrG5L4NnuvncRa-2REZjLSwr-dMI1Skkx1aNdOhrHbzy667hVW4vBBdfkOioGzt-5UsedAw6hCGYe6ublWQFmUNjwHtqkR2vDNvGUUdrWjEC9LoWs Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Domain-Id: None Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Domain-Name: None Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Identity-Status: Confirmed Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Is-Admin-Project: True Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Domain-Id: default Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Domain-Name: Default Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Project-Name: admin Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Role: member,reader,admin Jun 15 10:07:12.254710 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Roles: member,reader,admin Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5ca5bc2dcee64d0eb4fea80b38a3107c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant: admin Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-Tenant-Name: admin Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User: admin Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Domain-Id: default Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Domain-Name: Default Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Id: cb3264418d25466c8226592c04529c8a Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: X-User-Name: admin Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: method: > Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: exception: Flavor 451 could not be found. Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: action_args: {'id': '451'} Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:07:12.256362 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:12.257164 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.258176 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-75464ef7-f028-486a-b0de-a287da0dca9c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:07:12.259236 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-75464ef7-f028-486a-b0de-a287da0dca9c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061154 Jun 15 10:07:12.259236 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 10:07:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:07:12.265825 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-32be343f-4a41-4a10-a73a-4dd579e045bf admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:12.281667 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-32be343f-4a41-4a10-a73a-4dd579e045bf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019445 Jun 15 10:07:12.282191 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 10:07:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:07:12.292173 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:12.305768 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017257 Jun 15 10:07:12.306311 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Jun 15 10:07:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:07:12.315408 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-7bbc573c-eca5-42e6-9850-3a0f756ce193 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:12.321107 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.wsgi [None req-7bbc573c-eca5-42e6-9850-3a0f756ce193 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-7bbc573c-eca5-42e6-9850-3a0f756ce193 admin admin] Request method failure captured: Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Accept: application/json Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Accept-Encoding: gzip, deflate Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Connection: keep-alive Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Content-Length: 0 Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Host: 10.222.0.57 Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Openstack-Api-Version: compute 2.90 Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Openstack-System-Scope: None Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: User-Agent: python-novaclient Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Auth-Token: gAAAAABiqa9Qo0CMExK4XwWXsyoSWdcik01gBvF9rrJun3taD0HJnwrZ5ZcuF4y5wwVgBcRrG5L4NnuvncRa-2REZjLSwr-dMI1Skkx1aNdOhrHbzy667hVW4vBBdfkOioGzt-5UsedAw6hCGYe6ublWQFmUNjwHtqkR2vDNvGUUdrWjEC9LoWs Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Domain-Id: None Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Domain-Name: None Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Identity-Status: Confirmed Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Is-Admin-Project: True Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Domain-Id: default Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Domain-Name: Default Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Project-Name: admin Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Role: member,reader,admin Jun 15 10:07:12.322621 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Roles: member,reader,admin Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5ca5bc2dcee64d0eb4fea80b38a3107c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5ca5bc2dcee64d0eb4fea80b38a3107c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant: admin Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant-Id: 5ca5bc2dcee64d0eb4fea80b38a3107c Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-Tenant-Name: admin Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User: admin Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Domain-Id: default Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Domain-Name: Default Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Id: cb3264418d25466c8226592c04529c8a Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: X-User-Name: admin Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: method: > Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: exception: Flavor 451 could not be found. Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: action_args: {'id': '451'} Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:07:12.324122 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:12.325231 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: ERROR nova.api.openstack.wsgi Jun 15 10:07:12.326558 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-7bbc573c-eca5-42e6-9850-3a0f756ce193 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:07:12.327849 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-7bbc573c-eca5-42e6-9850-3a0f756ce193 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012057 Jun 15 10:07:12.327849 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 10:07:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 10:07:13.199562 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:13.200574 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 15 10:07:13.200970 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:07:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:13.399261 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-dfca320d-12a5-491a-b71a-0a1f57792e02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:07:13.416840 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-dfca320d-12a5-491a-b71a-0a1f57792e02 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070150 Jun 15 10:07:13.417381 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Jun 15 10:07:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:07:14.296214 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:14.297223 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 15 10:07:14.297620 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:14.488961 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-81fb418a-8fe7-48ef-ae3d-c13bcf6313a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:07:14.505741 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-81fb418a-8fe7-48ef-ae3d-c13bcf6313a7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070172 Jun 15 10:07:14.506423 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Jun 15 10:07:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:07:15.390334 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:15.391347 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 15 10:07:15.391743 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:07:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:15.582910 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-d1d3244b-2790-4f7d-b344-516ae3b4fb79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:07:15.600082 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-d1d3244b-2790-4f7d-b344-516ae3b4fb79 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069091 Jun 15 10:07:15.600859 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Jun 15 10:07:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:07:16.480201 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:16.481218 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 15 10:07:16.481654 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:16.671923 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-07e3f2f5-e7f3-4c71-9658-0d94be97b9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:07:16.690655 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-07e3f2f5-e7f3-4c71-9658-0d94be97b9a4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070367 Jun 15 10:07:16.691137 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Jun 15 10:07:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:07:17.562031 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:17.563078 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 15 10:07:17.563475 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:07:17.754262 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-60deee58-d0b2-4e09-b19b-31dae55bf40d admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:07:17.773542 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-60deee58-d0b2-4e09-b19b-31dae55bf40d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071338 Jun 15 10:07:17.774188 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Wed Jun 15 10:07:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:08:05.999495 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:08:06.000494 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-058e9e2f-d503-4df8-9b5a-b89b1041f482 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 15 10:08:06.000892 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Wed Jun 15 10:08:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:08:06.011212 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:08:06.062101 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-32fe1b2d-7ce2-43b7-b10a-cb5254900500 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:08:06.081114 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-32fe1b2d-7ce2-43b7-b10a-cb5254900500 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074499 Jun 15 10:08:06.081674 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Wed Jun 15 10:08:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:08:06.105476 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-d7bf872f-5126-460e-994e-1bc61446411d admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:08:06.108977 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG dbcounter [-] [103333] Writing DB stats nova_api:SELECT=14 {{(pid=103333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:08:06.114602 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-d7bf872f-5126-460e-994e-1bc61446411d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013564 Jun 15 10:08:06.115150 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Wed Jun 15 10:08:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:08:06.127693 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-bd5a1a40-aef8-4838-8e89-17153ea8be69 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:08:06.136089 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-bd5a1a40-aef8-4838-8e89-17153ea8be69 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012469 Jun 15 10:08:06.136624 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Wed Jun 15 10:08:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:08:06.148383 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:08:06.157006 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012219 Jun 15 10:08:06.157521 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Wed Jun 15 10:08:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:08:06.169258 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-042c4b30-956b-4aeb-b774-1fb00ee05c81 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:08:06.177240 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-042c4b30-956b-4aeb-b774-1fb00ee05c81 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012198 Jun 15 10:08:06.177765 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Wed Jun 15 10:08:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:11:24.103002 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:11:24.104029 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 15 10:11:24.104430 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:11:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:11:24.260586 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=6 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:11:24.378232 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-c4cf7053-a87a-402a-9331-895fc1afbc25 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:11:24.379428 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:11:24.379428 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jun 15 10:11:24.380670 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-c4cf7053-a87a-402a-9331-895fc1afbc25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:11:24.381111 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-c4cf7053-a87a-402a-9331-895fc1afbc25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:11:24.381894 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-c4cf7053-a87a-402a-9331-895fc1afbc25 admin admin] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:11:24.382354 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-c4cf7053-a87a-402a-9331-895fc1afbc25 admin admin] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:11:24.416797 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-c4cf7053-a87a-402a-9331-895fc1afbc25 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.158354 Jun 15 10:11:24.417965 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 10:11:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:11:25.317122 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:11:25.318130 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 15 10:11:25.318570 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:11:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:11:25.514455 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-c33deb35-6db1-4642-b9a5-f50aa21a0013 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:11:25.515652 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:11:25.515652 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jun 15 10:11:25.516846 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-c33deb35-6db1-4642-b9a5-f50aa21a0013 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:11:25.517283 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-c33deb35-6db1-4642-b9a5-f50aa21a0013 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:11:25.518056 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-c33deb35-6db1-4642-b9a5-f50aa21a0013 admin admin] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:11:25.518509 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-c33deb35-6db1-4642-b9a5-f50aa21a0013 admin admin] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:11:25.537960 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-c33deb35-6db1-4642-b9a5-f50aa21a0013 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075604 Jun 15 10:11:25.538540 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 10:11:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:11:36.858777 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:11:36.859777 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 15 10:11:36.860171 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:11:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:11:37.005501 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell0:SELECT=4 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:11:37.006226 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_cell1:SELECT=4 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:11:37.006858 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG dbcounter [-] [103334] Writing DB stats nova_api:SELECT=8 {{(pid=103334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:11:37.054507 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-4f8eb11d-d44b-4060-b58d-c0916d6e96ed admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:11:37.055669 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:11:37.055669 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jun 15 10:11:37.056854 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-4f8eb11d-d44b-4060-b58d-c0916d6e96ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:11:37.057302 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-4f8eb11d-d44b-4060-b58d-c0916d6e96ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:11:37.058093 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-4f8eb11d-d44b-4060-b58d-c0916d6e96ed admin admin] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:11:37.059225 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-4f8eb11d-d44b-4060-b58d-c0916d6e96ed admin admin] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:11:37.084392 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-4f8eb11d-d44b-4060-b58d-c0916d6e96ed admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083353 Jun 15 10:11:37.084884 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 10:11:36 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:11:37.969880 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: DEBUG nova.api.openstack.wsgi [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] Calling method '>' {{(pid=103333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:11:37.970915 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: INFO nova.api.openstack.requestlog [None req-f6bd9562-4ce2-45cd-af6e-a99f98fde6c4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 15 10:11:37.971313 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: [pid: 103333|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Jun 15 10:11:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:11:38.167030 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG nova.api.openstack.wsgi [None req-a7a8c733-198e-4862-b583-f29301e452f6 admin admin] Calling method '>' {{(pid=103334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:11:38.168948 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:11:38.168948 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: warnings.warn(msg) Jun 15 10:11:38.170101 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-a7a8c733-198e-4862-b583-f29301e452f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:11:38.170568 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-a7a8c733-198e-4862-b583-f29301e452f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:11:38.171348 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-a7a8c733-198e-4862-b583-f29301e452f6 admin admin] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:11:38.171777 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: DEBUG oslo_concurrency.lockutils [None req-a7a8c733-198e-4862-b583-f29301e452f6 admin admin] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:11:38.193564 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: INFO nova.api.openstack.requestlog [None req-a7a8c733-198e-4862-b583-f29301e452f6 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077506 Jun 15 10:11:38.194046 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: [pid: 103334|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Jun 15 10:11:38 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:12:37.148123 dv-cinder-830283-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 10:12:37.148651 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: Wed Jun 15 10:12:37 2022 - graceful shutdown triggered... Jun 15 10:12:37.149078 dv-cinder-830283-5-iscsi devstack@n-api.service[103334]: Gracefully killing worker 2 (pid: 103334)... Jun 15 10:12:37.149432 dv-cinder-830283-5-iscsi devstack@n-api.service[103333]: Gracefully killing worker 1 (pid: 103333)... Jun 15 10:12:38.149560 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: worker 1 buried after 1 seconds Jun 15 10:12:38.150007 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: worker 2 buried after 1 seconds Jun 15 10:12:38.150007 dv-cinder-830283-5-iscsi devstack@n-api.service[103332]: goodbye to uWSGI. Jun 15 10:12:38.151156 dv-cinder-830283-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 10:12:38.151750 dv-cinder-830283-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 10:12:38.154550 dv-cinder-830283-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 10:12:38.163819 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 10:12:38 2022] *** Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: nodename: dv-cinder-830283-5-iscsi Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: machine: x86_64 Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: clock source: unix Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: pcre jit disabled Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: detected number of CPU cores: 4 Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: current working directory: / Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: detected binary path: /usr/bin/uwsgi-core Jun 15 10:12:38.165824 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: your processes number limit is 47680 Jun 15 10:12:38.166677 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: your memory page size is 4096 bytes Jun 15 10:12:38.166677 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: detected max file descriptor number: 2048 Jun 15 10:12:38.166677 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: lock engine: pthread robust mutexes Jun 15 10:12:38.166677 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: thunder lock: enabled Jun 15 10:12:38.166677 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 10:12:38.166677 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 10:12:38.210822 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: Python main interpreter initialized at 0x55938738b9c0 Jun 15 10:12:38.210822 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: python threads support enabled Jun 15 10:12:38.210822 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: your server socket listen backlog is limited to 100 connections Jun 15 10:12:38.210822 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: your mercy for graceful operations on workers is 90 seconds Jun 15 10:12:38.211302 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 10:12:38.211302 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: *** Operational MODE: preforking *** Jun 15 10:12:38.211560 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: *** uWSGI is running in multiple interpreter mode *** Jun 15 10:12:38.211560 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: spawned uWSGI master process (pid: 117701) Jun 15 10:12:38.211761 dv-cinder-830283-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 10:12:38.212363 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: spawned uWSGI worker 1 (pid: 117720, cores: 1) Jun 15 10:12:38.214315 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: spawned uWSGI worker 2 (pid: 117721, cores: 1) Jun 15 10:12:38.214315 dv-cinder-830283-5-iscsi devstack@n-api.service[117701]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 10:12:38.887001 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:12:38.894462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:12:40.164720 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:12:40.164720 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: from cryptography.utils import int_from_bytes Jun 15 10:12:40.165368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:12:40.165368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: from cryptography.utils import int_from_bytes Jun 15 10:12:40.170245 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:12:40.170245 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: from cryptography.utils import int_from_bytes Jun 15 10:12:40.170731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:12:40.170731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: from cryptography.utils import int_from_bytes Jun 15 10:12:42.616899 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:12:42.617438 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:12:42.617728 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:12:42.618048 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:12:42.618339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:12:42.618774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.619068 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.619408 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.619723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.620063 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.620385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.620713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.621039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.621373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.621641 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.621960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.622316 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830283-5-iscsi {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.622653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.622971 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.623288 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.623610 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.623921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.624251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.625148 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.625702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.627067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.627067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.627067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.627470 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.627722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.628035 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.628364 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.628683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.629016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.629328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.629742 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830283-5-iscsi {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.630074 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.630419 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.630746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.631166 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.631484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.631800 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.632129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.632459 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.632769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.633105 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.633436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.633762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.634085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.634419 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.634736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.635057 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.635382 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.635697 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.636029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.636264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.636579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.636914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.637240 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.637566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.637822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.638077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.638425 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.638763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.639070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.639386 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.639698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.640617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.641043 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.641350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.641763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.642083 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.642441 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.642773 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.643106 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.643424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.643758 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.644172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.644431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.644744 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.645096 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.645422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.645740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.646067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.646422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.646739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.647058 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.647373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.647700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.648077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.648390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.648650 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.648962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.649276 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.649603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.649920 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.650237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.650574 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.650893 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.651200 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.651515 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.651830 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.652142 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.652455 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.652767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.653080 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.653394 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.653702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.654041 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.654378 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.654691 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.655003 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.655317 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.656343 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.656790 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.657122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.657444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.657793 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.658092 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.658437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.658769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.659089 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.659406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.659734 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.660047 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.660362 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.660686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.661003 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.661317 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.661631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.661945 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.662253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.662585 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.662896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.663208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.663521 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.663844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.664173 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.664494 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.664806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.665119 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.665448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.665799 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.666141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.666517 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.666847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.667189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.667530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.667858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.668181 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.668503 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.668839 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.669159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.669479 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.669798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.670126 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.670473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.670814 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.671141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.671497 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.671823 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.672141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.672498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.672799 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.673129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.673447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.673795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.674140 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.674529 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.674822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.675150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.675467 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.675785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.676104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.676433 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.676776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.677102 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.677430 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.677751 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.677911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:12:42.678425 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.678580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:12:42.678724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.678864 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:12:42.679012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.679012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.679388 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:12:42.679388 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:12:42.679768 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.679768 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.680060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.680213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.680369 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.680509 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.680650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.680807 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.680956 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.681121 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.681344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.681517 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.681733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.681968 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.682140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.682410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.682568 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.682710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.682850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.682989 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.683136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.683291 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.683440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.683588 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.683759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830283-5-iscsi {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.683978 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.684133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.684283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.684439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.684604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.684836 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.684994 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.685161 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.685395 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.685549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.685696 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.685838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.685984 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.686133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.686300 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.686458 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.686642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.686791 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.687057 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.687227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.687376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.687517 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.687664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.687805 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.687946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.687946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.688232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.688395 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.688536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.688676 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.688824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.688972 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.689127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.689268 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.689434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.689649 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.689826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.690034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.690034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.690364 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830283-5-iscsi {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.690524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.690680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.690836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.690984 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.691682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.691776 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.691854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.691854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.692006 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.692079 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.692150 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.692221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.692374 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.692450 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.692530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.692609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.692687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.692758 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.692844 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.693040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.693211 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.693361 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.693505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.693657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.693816 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.693998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.694213 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.694390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.694532 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.694673 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.694845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.695076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.695223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.695388 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.695625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.695785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.695927 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.696078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.696227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.696375 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.696516 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.696666 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.696817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.696965 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.697106 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.697253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.697394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.697543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.697684 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.697827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.697975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.698125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.698324 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.698472 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.698613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.698764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.698905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.699045 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.699199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.699199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.699482 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.699669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.699885 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.700049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.700274 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.700432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.700574 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.700733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.700878 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.701018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.701157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.701307 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.701447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.701595 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.701746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.701895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.702043 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.702202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.702368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.703329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.703537 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.703685 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.703840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.703840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.703840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.704344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.704499 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.704652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.704808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.704957 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.705122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.705359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.705505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.705662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.705901 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.706056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.706205 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.706417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.706560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.706706 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.706867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.707009 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.707149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.707288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.707427 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.707574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.707715 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.707854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.708001 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.708142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.708296 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.708450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.708598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.708753 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.708900 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.709040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.709180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.709329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.709475 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.709615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.709754 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.709918 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.710142 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.710393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.710556 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.710716 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.710874 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.711016 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.711157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.711311 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.711451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.711590 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.711729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.711886 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.712035 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.712334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.712496 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.712646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.712806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.712947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.712947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.713451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.713600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.713749 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.713897 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.714037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.714190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.714429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.714429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.714704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.714854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.715005 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.715159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.715299 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.715299 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.715685 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.717029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.717189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.717189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.717478 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.717634 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.717784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.717784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.718217 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.718217 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.719023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.719182 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.719332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.719473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.719621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.719761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.719908 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.720057 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.720293 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.720524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.720688 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.720831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.720989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.721210 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.721352 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.721493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.721493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.721769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.721909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.722057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.722198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.722359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.722502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.722641 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.722798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.722951 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.723099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.723239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.723589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.723746 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.723898 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.724046 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.724188 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.724327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.724560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.724714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.724872 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.725024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.725173 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.725314 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.725460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.725460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.725849 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.726000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.726148 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.726306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.726463 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.726613 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.726764 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.726907 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.727238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:42.727424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.727576 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.727726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.727867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.728014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.728154 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.728301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.728441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.728589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.728736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.728878 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.729036 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.729177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.729325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.729472 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.729612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.729751 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.729751 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.730022 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.730177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.730476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.730476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.730849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.730990 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.731141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.731290 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.731431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.731578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.731719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.731858 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.732003 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.732157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.732297 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.732450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.732604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.732750 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.732960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.733123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.733123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.733402 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.733782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.733947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.733947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.734237 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.734409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.734586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.734816 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.734975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.735123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.735268 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.735425 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.735585 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.736085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.736239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.736395 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.736543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.736689 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.736689 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.736689 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.737119 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.737381 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.737535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.737701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.737863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.738011 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.738164 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.738329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.738494 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.738642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.738801 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.738957 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.739111 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.739266 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.739413 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.739566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.739754 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.740037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.740197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.740352 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.740599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.740839 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.740993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.741148 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.741303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.741460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.741615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.741776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.741925 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.742089 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.742235 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.742431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.742590 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.742748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.742902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.743049 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.743202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.743350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.743508 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.743870 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.744035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.744183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.744353 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.744508 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.744669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.744927 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.745081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.745228 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.745375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.745521 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.745682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.746536 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.746708 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.746879 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.747027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.747182 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.747337 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.747834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.748010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.748161 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.748316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.748465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.748619 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.748766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.748974 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.749144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.749329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.749572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.749724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.749871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.750027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.750183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.750424 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.750630 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.750892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.751204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.751361 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.751509 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.751668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.751822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.751969 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.752131 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.752278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.752425 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.752581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.752737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.752884 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.753042 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.753198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.753352 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.753499 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.753655 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.754041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.754213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.754398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.754554 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.754708 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.754856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.754856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.755256 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.755406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.755559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.755707 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.755860 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.756027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.756174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.756321 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.756493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.756748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.756902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.757065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.757220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.757369 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.757515 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.757779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.757949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.758136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.758495 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.758673 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.758823 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.759190 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.759356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.759515 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.759663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.759816 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.759989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.760154 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.760310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.760469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.760630 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.760777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.761021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.761270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.761440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.761590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.761743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.761891 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.762037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.762183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.762361 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.763303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.763479 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.764568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.764857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.765739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.765962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.766147 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.766379 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.766549 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.766700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.766986 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.767149 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.767297 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.767444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.767592 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.767777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.768046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.768201 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.768349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.768496 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.768643 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.768790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.768954 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.769207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.769363 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.769557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.769711 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.769873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.770034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.770190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.770373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.770525 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.770682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.770839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.771013 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.771013 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.771489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.771650 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.771797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.771953 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.772103 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.772261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.772416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.772563 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.772717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.772886 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.773036 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.773190 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.773339 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.773494 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.773649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.773797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.773952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.774112 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.774573 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.774753 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.774753 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.775061 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.775210 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.775356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.775510 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.775675 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.775908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776217 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776439 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776628 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.776913 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777296 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777376 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777520 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777520 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777670 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777874 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.777999 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.778099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.778199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.778306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.778395 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.778467 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.778759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.778937 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779402 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779774 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.779957 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.780087 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.780219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.780347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.780488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.780665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.782006 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.782157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.782418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.782557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.782699 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.782827 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.782956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.782956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.783192 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.783360 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.783498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.783628 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.783628 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.783628 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.783871 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.783962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784158 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784547 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.784923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785168 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785266 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785563 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785563 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785732 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.785914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786245 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.786905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787562 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787643 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787715 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787791 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787869 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.787946 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788340 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788431 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788716 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788872 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788956 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788956 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788956 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.788956 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.789226 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.789305 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.789389 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.789558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.789755 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.789862 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.790092 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.790175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.790441 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.790527 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.790779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.790861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.791114 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.791204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.791456 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.791551 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.791874 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.792198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.792512 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.792828 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.793083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.793185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.793450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.793540 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.793766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.793864 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.794083 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.794182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.794531 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.794751 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.794858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.795094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.795214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.795428 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.795533 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.795761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.795888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.796095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.796461 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.796663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.796844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.797112 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.797419 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.797573 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.797746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.797888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.798072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.798208 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.798415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.798561 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.798732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.798867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.799046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.799194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.799381 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.799515 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.799707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.799871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.800024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.800168 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.800334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.800479 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.800653 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.800755 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.800974 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.801066 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.801291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.801385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.801610 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.801728 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.801924 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.802015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.802241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.802386 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.802590 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.802700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.802906 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.803005 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.803219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.803317 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.803532 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.803624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.803845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.803994 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.804161 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.804254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.804474 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.804574 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.804786 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.804875 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.805097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.805188 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.805410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.805551 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.805719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.805846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.806086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.806320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.806448 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.806659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.806786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.806975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.807124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.807307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.807412 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.807632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.807740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.807947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.808072 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.808260 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.808369 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.808571 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.808681 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.808925 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.809039 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.809237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.809394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.809546 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.809640 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.809864 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.809970 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.810181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.810287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.810523 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.810615 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.810840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.810945 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.811154 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.811253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.811469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.811560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.811814 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.811998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.812165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.812491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.812602 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.812811 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.812911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.813135 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.813228 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.813457 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.813556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.813775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.813866 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.814096 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.814188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.814442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.814546 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.814766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.814865 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.815080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.815330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.815430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.815674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.815778 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.816000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.816094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.816310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.816409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.816630 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.816722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.816946 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.817046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.817257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.817347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.817583 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.817672 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.817901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.817992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.818203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.818449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.818564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.818675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.818846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.818939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.819162 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.819270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.819472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.819572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.819787 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.819886 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.820120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.820234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.820446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.820539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.820759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.820852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.821078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.821181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.821389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.821486 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.821700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.821807 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.822013 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.822124 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.822371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.822478 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.822689 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.822785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.823001 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.823102 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.823313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.823413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.823627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.823717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.823938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.824036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.824254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.824550 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.824643 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.824900 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.825004 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.825200 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.825294 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.825518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.825617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.825835 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.825946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.826174 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.826289 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.826523 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.826625 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.826845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.826937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.827172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.827275 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.828023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.828161 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.828539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.828863 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.828955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.829189 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.829282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.829513 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.829607 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.829839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.829930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.830157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.830248 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.830508 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.830601 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.830828 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.830929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.831227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.831368 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.831518 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.831609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.831766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.831985 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.832144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.832381 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.832600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.832723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.833034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.833216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.833307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.833420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.833670 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.833895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.834008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.834399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.834499 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.834649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.834833 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.834969 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.835154 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.835291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.835486 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.835615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.835818 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.835928 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.836144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.836254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.836465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.836619 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.836835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.837031 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.837128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.837402 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.837493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.837725 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.837829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.838044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.838146 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.838382 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.838498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.838708 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.838832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.839025 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.839154 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.839340 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.839476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.839649 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.839792 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.839966 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.840127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.840270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.840447 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.840593 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.840761 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.840905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.841080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.841215 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.841392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.841524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.841712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.841848 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.842027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.842128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.842455 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.842589 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.842767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.842870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.843117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.843932 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.844070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.844241 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.844409 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.844559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.844736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.844867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.845061 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.845174 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.845387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.845487 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.845714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.845860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.846031 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.846143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.846473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.846568 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.846788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.846882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.847106 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.847205 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.847424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.847515 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.847734 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.847826 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.848053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.848144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.848367 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.848464 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.848682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.848775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.848993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.849084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.849307 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.849403 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.849619 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.849864 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.849999 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.850203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.850326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.850554 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.850657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.850890 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.851020 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.851227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.851329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.851540 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.851633 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.851851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.852050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.852153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.852370 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.852536 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.852689 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.852781 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.853018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.853112 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.853348 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.853440 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.853678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.853770 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.853988 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.854087 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.854325 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.854433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.854639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.854730 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.854948 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.855039 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.855260 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.855360 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.855572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.855665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.855885 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.855977 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.856194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.856287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.856504 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.856619 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.856825 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.856940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.857141 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.857233 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.857466 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.857567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.857784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.857883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.858103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.858201 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.858495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.858652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.858794 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.859066 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.859159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.859410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.859508 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.859724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.859906 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.860042 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.860187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.860376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.860470 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.860960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.861069 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.861273 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.861363 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.861605 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.861697 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.861920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.862025 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.862239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.862437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.862583 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.862683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.862900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.863041 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.863214 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.863315 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.863528 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.863620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.863857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.863950 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.864169 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.864263 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.864481 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.864579 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.864807 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.864906 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.865136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.865228 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.865463 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.865556 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.865776 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.865867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.866082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.866180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.866443 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.866563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.866734 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.866874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.867044 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.867144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.867362 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.867468 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.867672 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.867771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.867981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.868073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.868289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.868393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.868602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.868700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.868954 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.869053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.869221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.869328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.869550 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.869652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.869841 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.869936 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.870155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.870250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.870488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.870592 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.870797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.870926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.871107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.871207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.871415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.871515 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.871724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.871824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.872032 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.872125 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.872345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.872437 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.872654 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.872768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.872962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.873055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.873269 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.873368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.873573 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.873673 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.873882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.873974 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.874210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.874435 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.874629 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.874952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.875143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.875278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.875482 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.875581 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.875805 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.875908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.876121 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.876242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.876522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.876639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.876754 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.876860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.877104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.877207 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.877417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.877510 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.877761 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.877854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.878076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.878166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.878420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.878517 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.878740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.878834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.879061 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.879195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.879383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.879483 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.879698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.879813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.880019 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.880138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.880343 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.880482 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.880651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.880744 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.880974 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.881109 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.881293 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.881402 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.881608 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.881700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.881925 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.882017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.882238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.882364 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.882580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.882715 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.882895 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.882985 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.883208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.883432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.883526 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.883767 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.883860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.884090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.884192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.884411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.884511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.884731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.884831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.885053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.885158 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.885372 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.885465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.885683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.885774 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.885998 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.886102 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.886338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.886497 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.886731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.886830 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.886975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.887122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.887314 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.887409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.887644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.887735 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.887963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.888055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.888278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.888371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.888591 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.888683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.888840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:12:42.888933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.889214 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.889577 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.889900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.891254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.891586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.891912 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.892238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.892560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.892882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.893206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.893527 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.893847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.894165 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.894512 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.894836 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.895170 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.895511 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.895839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.896169 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.896476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.896802 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.897328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.897651 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.897992 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.898347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.898681 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.899007 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.899331 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.899663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.899979 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.900294 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.900614 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.900931 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.901246 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.901575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.901892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.902205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.902557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.902876 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.903415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.903775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.904102 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.904439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.904775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.905101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.905419 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.906892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.907221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.907541 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.907875 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.908197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.908514 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.908833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.909152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.909472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.909787 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.910105 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.910444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.910782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.911096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.911410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.911722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.912039 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.912350 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.912662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.912976 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.913289 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.913609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.913922 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.914238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.914577 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.914893 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.915206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.915521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.915878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.916207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.916519 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.916831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.917154 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.917477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.917809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.918127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.918468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.918821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.919144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.919682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.920029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.920359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.920701 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.921041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.921902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.922238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.922595 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.922935 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.923263 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.923591 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.923917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.924237 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.924558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.924876 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.925196 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.925791 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.926116 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.926459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.926839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.927166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.927415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.927743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.928091 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.928417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.928739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.929064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.929390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.929710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.930030 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.930371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.930689 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.931010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.931350 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.931669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.931982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.932408 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.932729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.933067 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.933383 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.933704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.934034 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.934384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.934705 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.935032 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.935347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.935684 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.936029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.936366 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.936695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.938037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.938387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.938705 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.939027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.939356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.939674 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.939988 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.940299 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.940616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.940928 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.941241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.941554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.941868 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.942181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.942518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.942832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.943145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.943459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.943768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.944081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.944395 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.944705 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.945018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.945327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.945638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.945948 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.946878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.946878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.947094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.947269 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.947612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.947923 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.948239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.948567 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.948894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.949216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.949534 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.949876 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.950194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.950550 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.950871 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.951189 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.951505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.951824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.952160 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.953083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.953481 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO dbcounter [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Registered counter for database nova_api Jun 15 10:12:42.953946 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.954261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.954614 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.954947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.955277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.955600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.955940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.956260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.956580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.956905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.957224 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.957542 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.957874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.958195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.958556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.958891 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.959208 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.959541 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.959874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.960230 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.960551 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.960901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.961235 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.961556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.961876 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.962189 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:42.962461 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:12:42.973244 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_db.sqlalchemy.engines [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:42.979758 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writer thread running {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:43.028328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO dbcounter [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Registered counter for database nova_api Jun 15 10:12:43.037450 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.context [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8150241a-a1e8-4d3b-89e1-e7326b204d0a(cell1) {{(pid=117720) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:12:43.041583 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:12:43.043217 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:12:43.044022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:12:43.045990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:12:43.048110 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO dbcounter [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Registered counter for database nova_cell0 Jun 15 10:12:43.048695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_db.sqlalchemy.engines [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:43.052070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO dbcounter [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Registered counter for database nova_cell1 Jun 15 10:12:43.055195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writer thread running {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:43.059604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_db.sqlalchemy.engines [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:43.060812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_db.sqlalchemy.engines [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:43.067703 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writer thread running {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:43.069363 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writer thread running {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:43.114918 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.context [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8150241a-a1e8-4d3b-89e1-e7326b204d0a(cell1) {{(pid=117721) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:12:43.119164 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:12:43.120692 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:12:43.121487 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:12:43.123479 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:12:43.126572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO dbcounter [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Registered counter for database nova_cell0 Jun 15 10:12:43.130787 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO dbcounter [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Registered counter for database nova_cell1 Jun 15 10:12:43.138154 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_db.sqlalchemy.engines [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:43.139870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_db.sqlalchemy.engines [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:43.147194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writer thread running {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:43.149249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writer thread running {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:43.217027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO dbcounter [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Registered counter for database nova_cell0 Jun 15 10:12:43.225961 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_db.sqlalchemy.engines [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:43.230644 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writer thread running {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:43.302020 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO dbcounter [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Registered counter for database nova_cell0 Jun 15 10:12:43.308769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_db.sqlalchemy.engines [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:43.314873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writer thread running {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:43.560278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: WARNING keystonemiddleware.auth_token [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:12:43.568443 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: WARNING keystonemiddleware.auth_token [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:12:43.636077 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: WARNING keystonemiddleware.auth_token [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:12:43.643898 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: WARNING keystonemiddleware.auth_token [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:12:43.924215 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: WARNING keystonemiddleware.auth_token [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:12:43.929516 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: WARNING keystonemiddleware.auth_token [None req-843e9240-e76e-476d-99fa-5f77d38798ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:12:43.935074 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55938738b9c0 pid: 117720 (default app) Jun 15 10:12:43.996236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: WARNING keystonemiddleware.auth_token [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:12:44.002399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: WARNING keystonemiddleware.auth_token [None req-588252e8-04e1-4a13-be0f-94f7c7b7fd4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:12:44.007751 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55938738b9c0 pid: 117721 (default app) Jun 15 10:13:22.534042 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:22.535699 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:22.536584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:22.537486 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:23.398765 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c4f9dff2-94eb-4dfe-bad0-dc0019ed6c56 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Action: 'create', calling method: .version_select at 0x7fe257f57820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-134721005", "metadata": {"Type": "work"}}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c4f9dff2-94eb-4dfe-bad0-dc0019ed6c56 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Request method failure captured: Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 121 Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDCwmPFVqUE2NQFUYkjzMcI7SDJJdyHAaGxu-Em7cku_uTRGE_keqQNyKSO2v03spXeQ2fJ6Z8uqwH52kCshPE5iM6gxNfeYtV0cosZSZkNAwsEc9xpAWYGpAouF4paGEtmurNpV3JbQxToAQqxNWr1H4IuM1kMGBs6TE3hwFB6_mw Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:13:23.428835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_752562516b8547a28e864d89892088d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/752562516b8547a28e864d89892088d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: ebc597183c36486a99c6ba338c980690 Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-134721005", "metadata": {"Type": "work"}}} Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: Jun 15 10:13:23.430560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-134721005', 'metadata': {'Type': 'work'}}}} Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise error Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:23.431575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 10:13:23.433149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 10:13:23.434437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 10:13:23.434437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.434437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c4f9dff2-94eb-4dfe-bad0-dc0019ed6c56 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:23.434437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c4f9dff2-94eb-4dfe-bad0-dc0019ed6c56 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.917576 Jun 15 10:13:23.434437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Jun 15 10:13:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 920 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:13:23.444144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=3 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:23.445060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=3 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:23.445995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=3 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:23.446928 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=3 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:23.658712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2d876920-342d-4406-9299-48a93ef9e629 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Action: 'create', calling method: .version_select at 0x7fe257fab160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1689439979", "metadata": {"Type": "work"}}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2d876920-342d-4406-9299-48a93ef9e629 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Request method failure captured: Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 120 Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDCwmPFVqUE2NQFUYkjzMcI7SDJJdyHAaGxu-Em7cku_uTRGE_keqQNyKSO2v03spXeQ2fJ6Z8uqwH52kCshPE5iM6gxNfeYtV0cosZSZkNAwsEc9xpAWYGpAouF4paGEtmurNpV3JbQxToAQqxNWr1H4IuM1kMGBs6TE3hwFB6_mw Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:13:23.662784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_752562516b8547a28e864d89892088d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/752562516b8547a28e864d89892088d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: ebc597183c36486a99c6ba338c980690 Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1689439979", "metadata": {"Type": "work"}}} Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: Jun 15 10:13:23.664375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1689439979', 'metadata': {'Type': 'work'}}}} Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise error Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi '0' Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:23.665332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 10:13:23.667240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 10:13:23.668536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 10:13:23.668536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.668536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2d876920-342d-4406-9299-48a93ef9e629 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:23.668536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2d876920-342d-4406-9299-48a93ef9e629 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.225570 Jun 15 10:13:23.668536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 1/2] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Jun 15 10:13:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:13:23.676279 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0b12969d-a389-4685-a94c-f3aa832a79b6 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Action: 'create', calling method: .version_select at 0x7fe257f6caf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1532308182", "metadata": {"Type": "work"}}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0b12969d-a389-4685-a94c-f3aa832a79b6 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Request method failure captured: Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 119 Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDCwmPFVqUE2NQFUYkjzMcI7SDJJdyHAaGxu-Em7cku_uTRGE_keqQNyKSO2v03spXeQ2fJ6Z8uqwH52kCshPE5iM6gxNfeYtV0cosZSZkNAwsEc9xpAWYGpAouF4paGEtmurNpV3JbQxToAQqxNWr1H4IuM1kMGBs6TE3hwFB6_mw Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:13:23.678979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_752562516b8547a28e864d89892088d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/752562516b8547a28e864d89892088d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: ebc597183c36486a99c6ba338c980690 Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1532308182", "metadata": {"Type": "work"}}} Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: Jun 15 10:13:23.680523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1532308182', 'metadata': {'Type': 'work'}}}} Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise error Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi '' Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:23.681471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 10:13:23.683738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 10:13:23.685659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 10:13:23.685659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:23.685659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0b12969d-a389-4685-a94c-f3aa832a79b6 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:23.685659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0b12969d-a389-4685-a94c-f3aa832a79b6 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008912 Jun 15 10:13:23.685659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Jun 15 10:13:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:13:23.693302 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c4f51be-0d44-404c-a4d7-58769d12efe3 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Calling method '.version_select at 0x7fe257eb3430>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:24.766113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3a537cbc-7897-4e71-ba4f-12c5b741ba36 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Action: 'create', calling method: .version_select at 0x7fe257f57c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1140734410", "metadata": {"Type": "work"}}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:25.290069 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-5c4f51be-0d44-404c-a4d7-58769d12efe3 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] HTTP exception thrown: Volume tempest-invalid-900082970 could not be found. Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c4f51be-0d44-404c-a4d7-58769d12efe3 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Request method failure captured: Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-900082970 HTTP/1.1 Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDCwmPFVqUE2NQFUYkjzMcI7SDJJdyHAaGxu-Em7cku_uTRGE_keqQNyKSO2v03spXeQ2fJ6Z8uqwH52kCshPE5iM6gxNfeYtV0cosZSZkNAwsEc9xpAWYGpAouF4paGEtmurNpV3JbQxToAQqxNWr1H4IuM1kMGBs6TE3hwFB6_mw Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:13:25.296204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_752562516b8547a28e864d89892088d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/752562516b8547a28e864d89892088d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: ebc597183c36486a99c6ba338c980690 Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Volume tempest-invalid-900082970 could not be found. Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'tempest-invalid-900082970'} Jun 15 10:13:25.297806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-900082970 could not be found. (HTTP 404) (Request-ID: req-3ad2d955-622b-47a2-b8b2-7cbb9ba9cc1d) Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:25.298798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:13:25.300063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-900082970 could not be found. Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:13:25.301416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-900082970 could not be found. Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-900082970 could not be found. Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c4f51be-0d44-404c-a4d7-58769d12efe3 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Returning 404 to user: Volume tempest-invalid-900082970 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:25.302824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5c4f51be-0d44-404c-a4d7-58769d12efe3 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-900082970" status: 404 len: 98 microversion: 2.1 time: 1.611668 Jun 15 10:13:25.304605 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1214 bytes} [Wed Jun 15 10:13:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-900082970 => generated 98 bytes in 1618 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 15 10:13:25.310915 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-373a76d8-5a4e-4c49-9359-3387ad316c49 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004464 Jun 15 10:13:25.315436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1139 bytes} [Wed Jun 15 10:13:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 10:13:25.321349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0db385a8-186a-403c-8302-b3f7c9ec1ce9 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003809 Jun 15 10:13:25.322439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 4/6] 10.222.0.57 () {58 vars in 1136 bytes} [Wed Jun 15 10:13:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 10:13:25.332504 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-636ab28d-b0b3-48e3-be90-1d7d4dd053fa tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Calling method '.version_select at 0x7fe257daf550>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:25.433042 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-636ab28d-b0b3-48e3-be90-1d7d4dd053fa tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] HTTP exception thrown: Volume fbbec252-28ab-4288-9d17-a720c0dbe1b6 could not be found. Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-636ab28d-b0b3-48e3-be90-1d7d4dd053fa tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Request method failure captured: Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/os-volumes/fbbec252-28ab-4288-9d17-a720c0dbe1b6 HTTP/1.1 Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDCwmPFVqUE2NQFUYkjzMcI7SDJJdyHAaGxu-Em7cku_uTRGE_keqQNyKSO2v03spXeQ2fJ6Z8uqwH52kCshPE5iM6gxNfeYtV0cosZSZkNAwsEc9xpAWYGpAouF4paGEtmurNpV3JbQxToAQqxNWr1H4IuM1kMGBs6TE3hwFB6_mw Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:13:25.435846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_752562516b8547a28e864d89892088d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/752562516b8547a28e864d89892088d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: ebc597183c36486a99c6ba338c980690 Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Volume fbbec252-28ab-4288-9d17-a720c0dbe1b6 could not be found. Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'fbbec252-28ab-4288-9d17-a720c0dbe1b6'} Jun 15 10:13:25.437904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbbec252-28ab-4288-9d17-a720c0dbe1b6 could not be found. (HTTP 404) (Request-ID: req-4d99aeb5-5900-4fca-ac00-89a8900823d8) Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:25.438878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:13:25.440555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbbec252-28ab-4288-9d17-a720c0dbe1b6 could not be found. Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 10:13:25.441975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbbec252-28ab-4288-9d17-a720c0dbe1b6 could not be found. Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbbec252-28ab-4288-9d17-a720c0dbe1b6 could not be found. Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-636ab28d-b0b3-48e3-be90-1d7d4dd053fa tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Returning 404 to user: Volume fbbec252-28ab-4288-9d17-a720c0dbe1b6 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-636ab28d-b0b3-48e3-be90-1d7d4dd053fa tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/fbbec252-28ab-4288-9d17-a720c0dbe1b6" status: 404 len: 109 microversion: 2.1 time: 0.108810 Jun 15 10:13:25.443596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 5/7] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:13:25 2022] DELETE /compute/v2.1/os-volumes/fbbec252-28ab-4288-9d17-a720c0dbe1b6 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:13:25.552398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-58014a7d-3e3a-4630-afdd-0e33edf913d4 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Action: 'create', calling method: .version_select at 0x7fe257e00e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-864967625"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:26.712634 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3a537cbc-7897-4e71-ba4f-12c5b741ba36 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.201144 Jun 15 10:13:26.713645 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 3/8] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Jun 15 10:13:24 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2203 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 15 10:13:26.723681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-032d6d82-0f0f-465b-bde6-cda4e50d7530 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Calling method '.version_select at 0x7fe257dea160>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:26.771435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-58014a7d-3e3a-4630-afdd-0e33edf913d4 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.332654 Jun 15 10:13:26.772035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 6/9] 10.222.0.57 () {60 vars in 1154 bytes} [Wed Jun 15 10:13:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1334 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 10:13:27.100729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-773559385", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "networks": [{"uuid": "d7904b12-9c6c-4c99-9c26-bf97fa060089"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:27.318179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] validate_networks() for [('d7904b12-9c6c-4c99-9c26-bf97fa060089', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:13:27.398620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-032d6d82-0f0f-465b-bde6-cda4e50d7530 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] HTTP exception thrown: Volume f9d64381-161e-48ea-88c5-efa7f593009c could not be found. Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-032d6d82-0f0f-465b-bde6-cda4e50d7530 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Request method failure captured: Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/os-volumes/f9d64381-161e-48ea-88c5-efa7f593009c HTTP/1.1 Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDCwmPFVqUE2NQFUYkjzMcI7SDJJdyHAaGxu-Em7cku_uTRGE_keqQNyKSO2v03spXeQ2fJ6Z8uqwH52kCshPE5iM6gxNfeYtV0cosZSZkNAwsEc9xpAWYGpAouF4paGEtmurNpV3JbQxToAQqxNWr1H4IuM1kMGBs6TE3hwFB6_mw Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:13:27.403088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_752562516b8547a28e864d89892088d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/752562516b8547a28e864d89892088d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/752562516b8547a28e864d89892088d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 752562516b8547a28e864d89892088d7 Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesNegativeTest-1948508575 Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: ebc597183c36486a99c6ba338c980690 Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesNegativeTest-1948508575-project Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Volume f9d64381-161e-48ea-88c5-efa7f593009c could not be found. Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': 'f9d64381-161e-48ea-88c5-efa7f593009c'} Jun 15 10:13:27.405301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9d64381-161e-48ea-88c5-efa7f593009c could not be found. (HTTP 404) (Request-ID: req-962b791f-bcfd-418d-a927-15a7114a9a0d) Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:27.406480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:27.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9d64381-161e-48ea-88c5-efa7f593009c could not be found. Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:13:27.409287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9d64381-161e-48ea-88c5-efa7f593009c could not be found. Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9d64381-161e-48ea-88c5-efa7f593009c could not be found. Jun 15 10:13:27.410656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:27.414213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-032d6d82-0f0f-465b-bde6-cda4e50d7530 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] Returning 404 to user: Volume f9d64381-161e-48ea-88c5-efa7f593009c could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:27.414213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-032d6d82-0f0f-465b-bde6-cda4e50d7530 tempest-VolumesNegativeTest-1948508575 tempest-VolumesNegativeTest-1948508575-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/f9d64381-161e-48ea-88c5-efa7f593009c" status: 404 len: 109 microversion: 2.1 time: 0.697793 Jun 15 10:13:27.416250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 4/10] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:26 2022] GET /compute/v2.1/os-volumes/f9d64381-161e-48ea-88c5-efa7f593009c => generated 109 bytes in 702 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:13:27.435608 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1aeab790-eaa9-45de-a50d-feedbc56c7b4 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Calling method '.version_select at 0x7fe257dad820>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:27.597787 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1aeab790-eaa9-45de-a50d-feedbc56c7b4 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708" status: 200 len: 353 microversion: 2.1 time: 0.179804 Jun 15 10:13:27.598599 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 5/11] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:27 2022] GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:27.604827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d04c3103-4406-4731-afe2-15f77ec58ee7 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe257dadee0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:27.702929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d04c3103-4406-4731-afe2-15f77ec58ee7 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e" status: 200 len: 344 microversion: 2.1 time: 0.103098 Jun 15 10:13:27.703614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:27 2022] GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:28.609958 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a2fa5a25-c17f-4e4a-b5ce-9c276dcc1493 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Calling method '.version_select at 0x7fe257dadb80>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:28.711082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a2fa5a25-c17f-4e4a-b5ce-9c276dcc1493 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708" status: 200 len: 354 microversion: 2.1 time: 0.102982 Jun 15 10:13:28.711822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:28 2022] GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:13:28.718521 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1cbd777e-af47-402b-ba59-7f150d223481 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe257dc1040>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:28.862408 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1cbd777e-af47-402b-ba59-7f150d223481 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e" status: 200 len: 345 microversion: 2.1 time: 0.149010 Jun 15 10:13:28.863039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 8/14] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:28 2022] GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:28.879438 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c83a064a-a458-41ae-94f9-255c6ee041c8 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Calling method '.version_select at 0x7fe257dc1700>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:28.911599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:13:28.913410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:13:28.914097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:13:28.914780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:13:28.916469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:13:28.948615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:28.949457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:28.953963 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:28.954794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:28.995331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c83a064a-a458-41ae-94f9-255c6ee041c8 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708" status: 200 len: 354 microversion: 2.1 time: 0.124701 Jun 15 10:13:28.996286 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 9/15] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:28 2022] GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708 => generated 354 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:29.003858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dec2f57d-b338-4ecd-b250-fc2296bb81f9 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Action: 'create', calling method: .version_select at 0x7fe257dad5e0>, body: {"snapshot": {"volume_id": "37923664-7570-4ac2-a4b4-e7994aef6b9e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1262762045"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:29.035761 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Getting quotas for project c5f1dab6f20e41308d7d4a58e42140d6. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:13:29.054992 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Getting quotas for user 506c7cbec190453cabb8fd8049a14cf9 and project c5f1dab6f20e41308d7d4a58e42140d6. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:13:29.084086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:13:29.090749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:13:29.340221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b64d6aff-857d-4f41-9fb2-19f52771b6f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.521037 Jun 15 10:13:29.340221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 7/16] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:13:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:13:29.340221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5f6a46a7-0723-42f5-9e43-ec701569bbfd tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Calling method '.version_select at 0x7fe257cb2700>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:29.538475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5f6a46a7-0723-42f5-9e43-ec701569bbfd tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708" status: 202 len: 0 microversion: 2.1 time: 0.239111 Jun 15 10:13:29.543624 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 8/17] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:13:29 2022] DELETE /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:13:29.550062 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-770a36e6-c026-4894-877f-8b8bde714779 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:29.552661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-770a36e6-c026-4894-877f-8b8bde714779 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:29.738683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dec2f57d-b338-4ecd-b250-fc2296bb81f9 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.740094 Jun 15 10:13:29.749393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 10/18] 10.222.0.57 () {60 vars in 1161 bytes} [Wed Jun 15 10:13:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:29.755968 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-411df14e-6573-4609-bf23-452a86c36593 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Calling method '.version_select at 0x7fe257dc1790>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:29.869952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-411df14e-6573-4609-bf23-452a86c36593 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708" status: 200 len: 353 microversion: 2.1 time: 0.118777 Jun 15 10:13:29.871651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 11/19] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:29 2022] GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:29.885881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ca6711d1-1969-490e-8f84-3f89b1712e9b tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe257dc1040>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:29.898653 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-770a36e6-c026-4894-877f-8b8bde714779 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:29.933113 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-770a36e6-c026-4894-877f-8b8bde714779 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1214 microversion: 2.1 time: 0.387437 Jun 15 10:13:29.941197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 9/20] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:29 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1214 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:30.068952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ca6711d1-1969-490e-8f84-3f89b1712e9b tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 200 len: 287 microversion: 2.1 time: 0.192477 Jun 15 10:13:30.082035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-585d558e-ea97-4a9a-ae27-c8a79ea5d154 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256c52b80>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:30.082521 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 12/21] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:29 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 287 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:30.171209 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-585d558e-ea97-4a9a-ae27-c8a79ea5d154 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.092654 Jun 15 10:13:30.171537 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 10/22] 10.222.0.57 () {58 vars in 1139 bytes} [Wed Jun 15 10:13:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:30.183113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b931383d-a6f1-4a8c-87f5-0400f6b635b8 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe257dc15e0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:30.249687 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b931383d-a6f1-4a8c-87f5-0400f6b635b8 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 200 len: 287 microversion: 2.1 time: 0.071592 Jun 15 10:13:30.254315 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 13/23] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:30 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:30.886749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3f5e0ce2-06c3-48de-b96e-1cbcdd3eeca3 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Calling method '.version_select at 0x7fe256c52820>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:30.958954 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3333878e-2358-4ad3-806c-58af21877cbf tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:30.959743 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3333878e-2358-4ad3-806c-58af21877cbf tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:30.988100 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-3f5e0ce2-06c3-48de-b96e-1cbcdd3eeca3 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] HTTP exception thrown: Volume 532e3231-cf0d-40a9-853c-4bb5db64f708 could not be found. Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3f5e0ce2-06c3-48de-b96e-1cbcdd3eeca3 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Request method failure captured: Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708 HTTP/1.1 Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDEPAXZusd9EQcmxsOjvsGgOCEPUOot_R12CL9LvIz1rI3RFk0NvLjXCBqSy5Jg3e3agrTaM9XuRQoUInyuxgGAMJWuA3auwpa-KBjnQn6v_jqZmHBpXxDP2KA72ligbIE1caLj6jGtQYazdLcq8t12fZhMbp7oFMXgTIOwpQzJ88c Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 57780554d7a24aa499407bdc6a214405 Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesGetTestJSON-771167219 Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:13:30.990443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_57780554d7a24aa499407bdc6a214405", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/57780554d7a24aa499407bdc6a214405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/57780554d7a24aa499407bdc6a214405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/57780554d7a24aa499407bdc6a214405"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesGetTestJSON-771167219 Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 57780554d7a24aa499407bdc6a214405 Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesGetTestJSON-771167219 Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesGetTestJSON-771167219-project Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 08df9f76f97e4ab2b789487f16f70182 Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesGetTestJSON-771167219-project Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Volume 532e3231-cf0d-40a9-853c-4bb5db64f708 could not be found. Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '532e3231-cf0d-40a9-853c-4bb5db64f708'} Jun 15 10:13:30.992603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 532e3231-cf0d-40a9-853c-4bb5db64f708 could not be found. (HTTP 404) (Request-ID: req-19bc6914-a0bd-46d4-8755-ce05eb35f46f) Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:30.993547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:30.994895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 532e3231-cf0d-40a9-853c-4bb5db64f708 could not be found. Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:13:30.995902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 532e3231-cf0d-40a9-853c-4bb5db64f708 could not be found. Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 532e3231-cf0d-40a9-853c-4bb5db64f708 could not be found. Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3f5e0ce2-06c3-48de-b96e-1cbcdd3eeca3 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] Returning 404 to user: Volume 532e3231-cf0d-40a9-853c-4bb5db64f708 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3f5e0ce2-06c3-48de-b96e-1cbcdd3eeca3 tempest-VolumesGetTestJSON-771167219 tempest-VolumesGetTestJSON-771167219-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708" status: 404 len: 109 microversion: 2.1 time: 0.111969 Jun 15 10:13:30.996910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 11/24] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:30 2022] GET /compute/v2.1/os-volumes/532e3231-cf0d-40a9-853c-4bb5db64f708 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:13:31.249931 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3333878e-2358-4ad3-806c-58af21877cbf tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:31.264782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-128a7d4f-175a-4794-a9ec-402f41efa704 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256c7e310>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:31.306520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3333878e-2358-4ad3-806c-58af21877cbf tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1214 microversion: 2.1 time: 0.349528 Jun 15 10:13:31.307141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 14/25] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:30 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1214 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:13:31.362828 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-128a7d4f-175a-4794-a9ec-402f41efa704 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 200 len: 287 microversion: 2.1 time: 0.104653 Jun 15 10:13:31.363425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 12/26] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:31 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:13:32.324506 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dc041b26-8028-433c-bb4e-104359560d90 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:32.326078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dc041b26-8028-433c-bb4e-104359560d90 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:32.338597 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc041b26-8028-433c-bb4e-104359560d90 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:32.339296 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc041b26-8028-433c-bb4e-104359560d90 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:32.340272 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc041b26-8028-433c-bb4e-104359560d90 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:32.341760 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc041b26-8028-433c-bb4e-104359560d90 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:32.378355 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-425168d7-4f0b-42c3-929e-a271988f0616 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256c6df70>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:32.470610 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-425168d7-4f0b-42c3-929e-a271988f0616 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 200 len: 287 microversion: 2.1 time: 0.099894 Jun 15 10:13:32.475764 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:32 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:32.635243 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dc041b26-8028-433c-bb4e-104359560d90 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:32.661473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dc041b26-8028-433c-bb4e-104359560d90 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1218 microversion: 2.1 time: 0.341482 Jun 15 10:13:32.662380 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:32 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1218 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:33.484807 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0cb31e73-9d21-4910-96a6-40d07b17a346 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256c52790>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:33.577832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0cb31e73-9d21-4910-96a6-40d07b17a346 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 200 len: 287 microversion: 2.1 time: 0.099415 Jun 15 10:13:33.578630 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 14/29] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:33 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:33.678882 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d1de03be-bddf-4ed3-958e-b00c69f6b049 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:33.679502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d1de03be-bddf-4ed3-958e-b00c69f6b049 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:33.688249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d1de03be-bddf-4ed3-958e-b00c69f6b049 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:33.689558 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d1de03be-bddf-4ed3-958e-b00c69f6b049 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:33.693393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d1de03be-bddf-4ed3-958e-b00c69f6b049 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:33.693849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d1de03be-bddf-4ed3-958e-b00c69f6b049 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:33.855409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d1de03be-bddf-4ed3-958e-b00c69f6b049 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:33.884099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d1de03be-bddf-4ed3-958e-b00c69f6b049 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1218 microversion: 2.1 time: 0.208919 Jun 15 10:13:33.887546 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 16/30] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:33 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:34.598740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d8d05b71-88c2-4bf7-8af7-7f05cc9f6b99 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256c7e0d0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:34.666014 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d8d05b71-88c2-4bf7-8af7-7f05cc9f6b99 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 200 len: 287 microversion: 2.1 time: 0.071015 Jun 15 10:13:34.670490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 15/31] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:34 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:34.907091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-80073ac5-6d81-4aaf-a360-23621e86bb13 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:34.908462 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-80073ac5-6d81-4aaf-a360-23621e86bb13 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:34.915560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80073ac5-6d81-4aaf-a360-23621e86bb13 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:34.916385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80073ac5-6d81-4aaf-a360-23621e86bb13 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:34.917896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80073ac5-6d81-4aaf-a360-23621e86bb13 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:34.918564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80073ac5-6d81-4aaf-a360-23621e86bb13 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:35.076796 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-80073ac5-6d81-4aaf-a360-23621e86bb13 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:35.086210 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-80073ac5-6d81-4aaf-a360-23621e86bb13 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1218 microversion: 2.1 time: 0.184550 Jun 15 10:13:35.097317 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 17/32] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:34 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1218 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:35.678817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8b8fe852-2a79-459d-9f9f-54ed2b8516c7 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256c7ec10>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:35.725074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8b8fe852-2a79-459d-9f9f-54ed2b8516c7 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 200 len: 287 microversion: 2.1 time: 0.051206 Jun 15 10:13:35.725641 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 16/33] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:35 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:36.113956 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-49aef353-1279-4f54-b804-e9e82bdadbeb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:36.115166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-49aef353-1279-4f54-b804-e9e82bdadbeb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:36.131552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49aef353-1279-4f54-b804-e9e82bdadbeb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:36.132015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49aef353-1279-4f54-b804-e9e82bdadbeb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:36.139712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49aef353-1279-4f54-b804-e9e82bdadbeb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:36.140386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49aef353-1279-4f54-b804-e9e82bdadbeb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:36.475140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-49aef353-1279-4f54-b804-e9e82bdadbeb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:36.508588 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-49aef353-1279-4f54-b804-e9e82bdadbeb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1210 microversion: 2.1 time: 0.396787 Jun 15 10:13:36.521291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 17/34] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:36 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1210 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:13:36.718357 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1364099098", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:36.738975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-222bcb52-684b-42a2-b8ac-c5e6bd5f8627 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256bebaf0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:37.018311 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] validate_networks() for [('943119de-a43a-4d84-a4ef-bf25ea5d9cf3', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:13:37.035979 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-222bcb52-684b-42a2-b8ac-c5e6bd5f8627 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 200 len: 288 microversion: 2.1 time: 0.301939 Jun 15 10:13:37.036554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 18/35] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:36 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 288 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:13:37.047843 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bb16b753-b5ad-4027-8f41-2cffa823fad8 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256beb9d0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:37.313067 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bb16b753-b5ad-4027-8f41-2cffa823fad8 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 202 len: 0 microversion: 2.1 time: 0.269341 Jun 15 10:13:37.318347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 19/36] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Jun 15 10:13:37 2022] DELETE /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:13:37.326603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cb6e241f-dcd6-4f89-936f-c7bd185a502f tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256beb5e0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:37.816750 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-cb6e241f-dcd6-4f89-936f-c7bd185a502f tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] HTTP exception thrown: Snapshot d972f488-782e-4e87-9192-fb71957cbd89 could not be found. Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cb6e241f-dcd6-4f89-936f-c7bd185a502f tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Request method failure captured: Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 HTTP/1.1 Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDFmuov4ayj6J2kHSdOyeixcYzDgqDhuZvWVbM61uy5mXaPrQRHFFiu1Z_fWCwA5lBZaRtRrASj8FPMJJRNTBeRzLrlkajMT5KxCkRizxXDi0VMXBjJYfkGp9NikBBKbTmWQbYcRgUTp__cIDHYdaYV2MENH7EurhaPcZbnwe7ypa4 Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 4e925f49443949868110949ae44c4240 Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:13:37.821057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4e925f49443949868110949ae44c4240", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e925f49443949868110949ae44c4240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4e925f49443949868110949ae44c4240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e925f49443949868110949ae44c4240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 4e925f49443949868110949ae44c4240 Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesSnapshotsTestJSON-580051365-project Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 78d1fc46c75b46898328b86ff5ed79bd Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesSnapshotsTestJSON-580051365-project Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Snapshot d972f488-782e-4e87-9192-fb71957cbd89 could not be found. Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'd972f488-782e-4e87-9192-fb71957cbd89'} Jun 15 10:13:37.822151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d972f488-782e-4e87-9192-fb71957cbd89 could not be found. (HTTP 404) (Request-ID: req-6ca71c52-8ce3-4df4-9ad9-07c32c36db05) Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:37.822879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:37.823695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d972f488-782e-4e87-9192-fb71957cbd89 could not be found. Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 10:13:37.824562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d972f488-782e-4e87-9192-fb71957cbd89 could not be found. Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d972f488-782e-4e87-9192-fb71957cbd89 could not be found. Jun 15 10:13:37.826286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:37.829004 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cb6e241f-dcd6-4f89-936f-c7bd185a502f tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Returning 404 to user: Snapshot d972f488-782e-4e87-9192-fb71957cbd89 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:37.830515 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cb6e241f-dcd6-4f89-936f-c7bd185a502f tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89" status: 404 len: 111 microversion: 2.1 time: 0.510498 Jun 15 10:13:37.831364 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 20/37] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Jun 15 10:13:37 2022] GET /compute/v2.1/os-snapshots/d972f488-782e-4e87-9192-fb71957cbd89 => generated 111 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:13:37.845207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f3064ea9-198f-4566-892c-095f1c804ce0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:37.848068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f3064ea9-198f-4566-892c-095f1c804ce0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:37.879181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f3064ea9-198f-4566-892c-095f1c804ce0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:37.880575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f3064ea9-198f-4566-892c-095f1c804ce0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:37.883731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f3064ea9-198f-4566-892c-095f1c804ce0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:37.910545 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f3064ea9-198f-4566-892c-095f1c804ce0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:38.191284 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f3064ea9-198f-4566-892c-095f1c804ce0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:38.201593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f3064ea9-198f-4566-892c-095f1c804ce0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1272 microversion: 2.1 time: 0.366480 Jun 15 10:13:38.217000 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 21/38] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:37 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1272 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:38.221391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-502fe3ab-5229-43ae-a693-2811c1dc91fe tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256b9faf0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:38.604856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-502fe3ab-5229-43ae-a693-2811c1dc91fe tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e" status: 202 len: 0 microversion: 2.1 time: 0.392929 Jun 15 10:13:38.613283 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 22/39] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:13:38 2022] DELETE /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:13:38.678564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0496c630-2ca0-4eaa-a6eb-34d7504e1376 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256bb8670>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:38.929014 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0496c630-2ca0-4eaa-a6eb-34d7504e1376 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e" status: 200 len: 344 microversion: 2.1 time: 0.312742 Jun 15 10:13:38.930321 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 23/40] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:38 2022] GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e => generated 344 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:39.224945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-720a9bc8-1b17-4aad-9c4f-48e60fbdd49e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:39.225892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-720a9bc8-1b17-4aad-9c4f-48e60fbdd49e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:39.253649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:39.264274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-720a9bc8-1b17-4aad-9c4f-48e60fbdd49e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:39.271786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-720a9bc8-1b17-4aad-9c4f-48e60fbdd49e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:39.274226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-720a9bc8-1b17-4aad-9c4f-48e60fbdd49e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:39.281850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-720a9bc8-1b17-4aad-9c4f-48e60fbdd49e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:39.879941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-720a9bc8-1b17-4aad-9c4f-48e60fbdd49e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:39.902622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-720a9bc8-1b17-4aad-9c4f-48e60fbdd49e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1272 microversion: 2.1 time: 0.679659 Jun 15 10:13:39.904863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 24/41] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:39 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1272 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:13:39.922355 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-65e0c3f8-b684-433c-8a71-7f78b91afada tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256c003a0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:39.939460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=8 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:40.064877 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-65e0c3f8-b684-433c-8a71-7f78b91afada tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/affc69e7-cfa6-4d4a-a759-98ab33dad49f" status: 200 len: 350 microversion: 2.1 time: 0.158149 Jun 15 10:13:40.066108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 25/42] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:39 2022] GET /compute/v2.1/os-volumes/affc69e7-cfa6-4d4a-a759-98ab33dad49f => generated 350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:40.256939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:13:40.258183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:13:40.259119 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:13:40.259927 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:13:40.260498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:13:40.318220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:40.321566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:40.326456 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:40.327785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:40.503157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Getting quotas for project ea38be6c5c604346974bc9acac9628cd. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:13:40.544638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Getting quotas for user a3ee143a68b64f6f84e569b2b1823c5c and project ea38be6c5c604346974bc9acac9628cd. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:13:40.594970 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:13:40.602283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:13:40.964307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9a6039d2-8843-4de2-b8db-b81b9693a6a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.910906 Jun 15 10:13:40.967502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 18/43] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:13:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 4917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:13:40.999104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-45cda08c-5c63-42ad-86d1-e06404978047 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe25739e9d0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:41.068535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-64530a6a-f46c-4d72-a761-3be2cb5df534 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'create', calling method: .version_select at 0x7fe256bb8280>, body: {"keypair": {"name": "tempest-keypair-1213979694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTd8mdxUUGgYqJxFcYCHozbzJkw6umzQQaZVuKK3zCIeHoRNnT+zlrXbtAJQ4p/kHiKUuZTaJmJPKAk6ZKhdFfZPnsNaX8c1tQpAYhkvURbQXDVI43KCGWNaSd++kkKNg=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:41.143971 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-64530a6a-f46c-4d72-a761-3be2cb5df534 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Getting quotas for project f30e2cce69fb4e9bba7c053c4a37ba07. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:13:41.158811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-64530a6a-f46c-4d72-a761-3be2cb5df534 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Getting quotas for user 021e68642b0d4384bf3ece64e8e2ad69 and project f30e2cce69fb4e9bba7c053c4a37ba07. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:13:41.254817 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-45cda08c-5c63-42ad-86d1-e06404978047 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] HTTP exception thrown: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-45cda08c-5c63-42ad-86d1-e06404978047 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Request method failure captured: Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e HTTP/1.1 Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDFmuov4ayj6J2kHSdOyeixcYzDgqDhuZvWVbM61uy5mXaPrQRHFFiu1Z_fWCwA5lBZaRtRrASj8FPMJJRNTBeRzLrlkajMT5KxCkRizxXDi0VMXBjJYfkGp9NikBBKbTmWQbYcRgUTp__cIDHYdaYV2MENH7EurhaPcZbnwe7ypa4 Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 4e925f49443949868110949ae44c4240 Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:13:41.258631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4e925f49443949868110949ae44c4240", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e925f49443949868110949ae44c4240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4e925f49443949868110949ae44c4240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e925f49443949868110949ae44c4240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 4e925f49443949868110949ae44c4240 Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesSnapshotsTestJSON-580051365-project Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 78d1fc46c75b46898328b86ff5ed79bd Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-580051365-project Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '37923664-7570-4ac2-a4b4-e7994aef6b9e'} Jun 15 10:13:41.260264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. (HTTP 404) (Request-ID: req-28520725-70be-4269-baba-e88aa92904e8) Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.261665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:41.263747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:13:41.266104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-45cda08c-5c63-42ad-86d1-e06404978047 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Returning 404 to user: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-45cda08c-5c63-42ad-86d1-e06404978047 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e" status: 404 len: 109 microversion: 2.1 time: 0.290416 Jun 15 10:13:41.268545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 19/44] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:40 2022] GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e => generated 109 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:13:41.270464 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-64530a6a-f46c-4d72-a761-3be2cb5df534 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.193843 Jun 15 10:13:41.272111 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 26/45] 10.222.0.57 () {62 vars in 1199 bytes} [Wed Jun 15 10:13:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1203 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 10:13:41.285335 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7f8361b6-8a44-44ed-933b-6b88d2bc736c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:41.287307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7f8361b6-8a44-44ed-933b-6b88d2bc736c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:41.293274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5d3df9e1-f7aa-4b4b-ae8b-5f211b6c0327 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:41.299434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5d3df9e1-f7aa-4b4b-ae8b-5f211b6c0327 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:41.312585 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8361b6-8a44-44ed-933b-6b88d2bc736c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:41.314590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8361b6-8a44-44ed-933b-6b88d2bc736c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:41.316328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8361b6-8a44-44ed-933b-6b88d2bc736c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:41.318243 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8361b6-8a44-44ed-933b-6b88d2bc736c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:41.514443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5d3df9e1-f7aa-4b4b-ae8b-5f211b6c0327 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:41.530428 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5d3df9e1-f7aa-4b4b-ae8b-5f211b6c0327 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1222 microversion: 2.1 time: 0.254087 Jun 15 10:13:41.540458 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 27/46] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:41 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1222 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:41.569873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-83247ee7-3412-40b0-bb72-74f027c27a79 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256bb8670>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:41.683863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-83247ee7-3412-40b0-bb72-74f027c27a79 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] HTTP exception thrown: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-83247ee7-3412-40b0-bb72-74f027c27a79 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Request method failure captured: Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e HTTP/1.1 Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDFmuov4ayj6J2kHSdOyeixcYzDgqDhuZvWVbM61uy5mXaPrQRHFFiu1Z_fWCwA5lBZaRtRrASj8FPMJJRNTBeRzLrlkajMT5KxCkRizxXDi0VMXBjJYfkGp9NikBBKbTmWQbYcRgUTp__cIDHYdaYV2MENH7EurhaPcZbnwe7ypa4 Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 4e925f49443949868110949ae44c4240 Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:13:41.686098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4e925f49443949868110949ae44c4240", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e925f49443949868110949ae44c4240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4e925f49443949868110949ae44c4240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e925f49443949868110949ae44c4240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 4e925f49443949868110949ae44c4240 Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesSnapshotsTestJSON-580051365-project Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 78d1fc46c75b46898328b86ff5ed79bd Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesSnapshotsTestJSON-580051365-project Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '37923664-7570-4ac2-a4b4-e7994aef6b9e'} Jun 15 10:13:41.687325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. (HTTP 404) (Request-ID: req-20d704c7-ddf5-45be-9c5a-60d7926bc251) Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.687968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:13:41.692097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 10:13:41.693173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-83247ee7-3412-40b0-bb72-74f027c27a79 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Returning 404 to user: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-83247ee7-3412-40b0-bb72-74f027c27a79 tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e" status: 404 len: 109 microversion: 2.1 time: 0.145742 Jun 15 10:13:41.694050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 28/47] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:13:41 2022] DELETE /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:13:41.701157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6c6f1af0-fd38-4c1f-baa4-36f46d97c1af tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Calling method '.version_select at 0x7fe256b9fee0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:41.786479 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-6c6f1af0-fd38-4c1f-baa4-36f46d97c1af tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] HTTP exception thrown: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6c6f1af0-fd38-4c1f-baa4-36f46d97c1af tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Request method failure captured: Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e HTTP/1.1 Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDFmuov4ayj6J2kHSdOyeixcYzDgqDhuZvWVbM61uy5mXaPrQRHFFiu1Z_fWCwA5lBZaRtRrASj8FPMJJRNTBeRzLrlkajMT5KxCkRizxXDi0VMXBjJYfkGp9NikBBKbTmWQbYcRgUTp__cIDHYdaYV2MENH7EurhaPcZbnwe7ypa4 Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 4e925f49443949868110949ae44c4240 Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:13:41.788839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4e925f49443949868110949ae44c4240", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e925f49443949868110949ae44c4240"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4e925f49443949868110949ae44c4240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4e925f49443949868110949ae44c4240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 4e925f49443949868110949ae44c4240 Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-580051365 Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesSnapshotsTestJSON-580051365-project Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 78d1fc46c75b46898328b86ff5ed79bd Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesSnapshotsTestJSON-580051365-project Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '37923664-7570-4ac2-a4b4-e7994aef6b9e'} Jun 15 10:13:41.789872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. (HTTP 404) (Request-ID: req-0991b4e1-032f-4081-9b1e-01bd6e8290e9) Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.790549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:13:41.791452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:13:41.792398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6c6f1af0-fd38-4c1f-baa4-36f46d97c1af tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] Returning 404 to user: Volume 37923664-7570-4ac2-a4b4-e7994aef6b9e could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:13:41.793280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6c6f1af0-fd38-4c1f-baa4-36f46d97c1af tempest-VolumesSnapshotsTestJSON-580051365 tempest-VolumesSnapshotsTestJSON-580051365-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e" status: 404 len: 109 microversion: 2.1 time: 0.099474 Jun 15 10:13:41.798813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 29/48] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:41 2022] GET /compute/v2.1/os-volumes/37923664-7570-4ac2-a4b4-e7994aef6b9e => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:13:41.899698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-891550220", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:42.068815 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] validate_networks() for [('943119de-a43a-4d84-a4ef-bf25ea5d9cf3', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:13:42.967290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7f8361b6-8a44-44ed-933b-6b88d2bc736c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:42.978000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7f8361b6-8a44-44ed-933b-6b88d2bc736c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 1.715586 Jun 15 10:13:42.983390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 20/49] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:41 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:43.045735 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b9b879c3-9862-4085-a7ec-a8cf953162d0 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256b4c280>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:43.169837 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b9b879c3-9862-4085-a7ec-a8cf953162d0 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/3491e369-96b7-48f6-8d11-adee49922d36" status: 200 len: 350 microversion: 2.1 time: 0.128244 Jun 15 10:13:43.173126 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 21/50] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:43 2022] GET /compute/v2.1/os-volumes/3491e369-96b7-48f6-8d11-adee49922d36 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:13:43.999109 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9ec6fa8f-9fbd-42c6-862f-a994412d2e03 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:43.999778 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9ec6fa8f-9fbd-42c6-862f-a994412d2e03 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:44.014154 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ec6fa8f-9fbd-42c6-862f-a994412d2e03 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:44.014681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ec6fa8f-9fbd-42c6-862f-a994412d2e03 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:44.015466 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ec6fa8f-9fbd-42c6-862f-a994412d2e03 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:44.015916 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ec6fa8f-9fbd-42c6-862f-a994412d2e03 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:44.891867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9ec6fa8f-9fbd-42c6-862f-a994412d2e03 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:44.906635 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9ec6fa8f-9fbd-42c6-862f-a994412d2e03 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.905056 Jun 15 10:13:44.907196 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 22/51] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:43 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:45.007080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:13:45.007940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:13:45.008687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:13:45.009309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:13:45.010392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:13:45.033905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:45.038255 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:45.040725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:45.046957 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:45.076196 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1fb85dae-3f93-4817-847c-4ef762bfb960 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256b4cca0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:45.131599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Getting quotas for project ea38be6c5c604346974bc9acac9628cd. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:13:45.136922 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Getting quotas for user a3ee143a68b64f6f84e569b2b1823c5c and project ea38be6c5c604346974bc9acac9628cd. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:13:45.150993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:13:45.154074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:13:45.308211 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-828218ed-15b8-4453-ab50-c88a43247542 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.416857 Jun 15 10:13:45.309762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 30/52] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:13:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 3420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:13:45.359279 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e23c83f8-2521-4733-b4f5-d83bd4a60e50 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:45.373821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e23c83f8-2521-4733-b4f5-d83bd4a60e50 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:45.886492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1fb85dae-3f93-4817-847c-4ef762bfb960 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/189f68ac-daa5-441a-953a-e6aca3d5d793" status: 200 len: 351 microversion: 2.1 time: 0.814051 Jun 15 10:13:45.887930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 23/53] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Jun 15 10:13:45 2022] GET /compute/v2.1/os-volumes/189f68ac-daa5-441a-953a-e6aca3d5d793 => generated 351 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:13:45.903674 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e23c83f8-2521-4733-b4f5-d83bd4a60e50 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:45.908620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9cf09081-3fe6-4287-b249-0497327a0ab2 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe2573be5e0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:45.921197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e23c83f8-2521-4733-b4f5-d83bd4a60e50 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1221 microversion: 2.1 time: 0.585529 Jun 15 10:13:45.938668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 31/54] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:45 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1221 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:45.993035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0969e821-1193-4161-be78-551564025fbd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:46.005255 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0969e821-1193-4161-be78-551564025fbd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:46.050197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0969e821-1193-4161-be78-551564025fbd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:46.051254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0969e821-1193-4161-be78-551564025fbd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:46.052045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0969e821-1193-4161-be78-551564025fbd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:46.052695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0969e821-1193-4161-be78-551564025fbd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:46.401189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9cf09081-3fe6-4287-b249-0497327a0ab2 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.505341 Jun 15 10:13:46.407023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 24/55] 10.222.0.57 () {58 vars in 1133 bytes} [Wed Jun 15 10:13:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:46.430702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-add94a65-b93d-4a00-a197-0840118e727a tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256b60940>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:46.819773 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-add94a65-b93d-4a00-a197-0840118e727a tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.409172 Jun 15 10:13:46.837051 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 25/56] 10.222.0.57 () {58 vars in 1148 bytes} [Wed Jun 15 10:13:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:46.952960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0969e821-1193-4161-be78-551564025fbd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:47.000855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0969e821-1193-4161-be78-551564025fbd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 1.059976 Jun 15 10:13:47.001788 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 32/57] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:45 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:47.017797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-853e9e75-e46f-4b7c-9c4f-8614a412f36a tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256b83550>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:47.392010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-853e9e75-e46f-4b7c-9c4f-8614a412f36a tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.384116 Jun 15 10:13:47.393521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 33/58] 10.222.0.57 () {58 vars in 1133 bytes} [Wed Jun 15 10:13:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:47.405954 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c2551a89-586e-4d6b-8d8c-43d238f54d41 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:47.406937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c2551a89-586e-4d6b-8d8c-43d238f54d41 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:47.427354 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c2551a89-586e-4d6b-8d8c-43d238f54d41 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:47.427983 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c2551a89-586e-4d6b-8d8c-43d238f54d41 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:47.428958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c2551a89-586e-4d6b-8d8c-43d238f54d41 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:47.429423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c2551a89-586e-4d6b-8d8c-43d238f54d41 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:47.600806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-3df12c37-fa1b-4ebd-a201-3640546a1b53 req-ecb4e4da-f0d1-4323-8faa-c9b1d08e1d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a", "tag": "4f233b8f-c4be-4757-8284-4c4bc12427d9"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:47.628143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3df12c37-fa1b-4ebd-a201-3640546a1b53 req-ecb4e4da-f0d1-4323-8faa-c9b1d08e1d22 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:47.628879 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3df12c37-fa1b-4ebd-a201-3640546a1b53 req-ecb4e4da-f0d1-4323-8faa-c9b1d08e1d22 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:47.682152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-3df12c37-fa1b-4ebd-a201-3640546a1b53 req-ecb4e4da-f0d1-4323-8faa-c9b1d08e1d22 service nova] Creating event network-changed:4f233b8f-c4be-4757-8284-4c4bc12427d9 for instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a on hv-cinder-83028 Jun 15 10:13:47.688116 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3df12c37-fa1b-4ebd-a201-3640546a1b53 req-ecb4e4da-f0d1-4323-8faa-c9b1d08e1d22 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 10:13:47.689867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b6613e2-9cb6-4253-8cf8-b1bc6f8b6ad8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:47.690838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b6613e2-9cb6-4253-8cf8-b1bc6f8b6ad8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:47.692059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b6613e2-9cb6-4253-8cf8-b1bc6f8b6ad8 None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:47.692678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b6613e2-9cb6-4253-8cf8-b1bc6f8b6ad8 None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:47.712915 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c2551a89-586e-4d6b-8d8c-43d238f54d41 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:47.717816 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.compute.rpcapi [None req-9b6613e2-9cb6-4253-8cf8-b1bc6f8b6ad8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 10:13:47.718934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b6613e2-9cb6-4253-8cf8-b1bc6f8b6ad8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 10:13:47.723115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c2551a89-586e-4d6b-8d8c-43d238f54d41 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1273 microversion: 2.1 time: 0.328242 Jun 15 10:13:47.729845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 34/59] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:47 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:47.752327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-998709d9-334b-45b9-b7ff-c02563d0f8bb tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256b83dc0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:47.802150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9b6613e2-9cb6-4253-8cf8-b1bc6f8b6ad8 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.963662 Jun 15 10:13:47.803024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 26/60] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:48.022368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-30dc5904-9549-447d-a89b-5cca06281d00 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:48.024073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-30dc5904-9549-447d-a89b-5cca06281d00 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:48.031428 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-998709d9-334b-45b9-b7ff-c02563d0f8bb tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.300084 Jun 15 10:13:48.032393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 35/61] 10.222.0.57 () {58 vars in 1166 bytes} [Wed Jun 15 10:13:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:48.037632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30dc5904-9549-447d-a89b-5cca06281d00 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:48.038318 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30dc5904-9549-447d-a89b-5cca06281d00 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:48.039645 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30dc5904-9549-447d-a89b-5cca06281d00 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:48.040101 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30dc5904-9549-447d-a89b-5cca06281d00 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:48.045402 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-42c5d19b-da02-4737-8867-39745dfa5be8 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256bc5ee0>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:48.875160 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-42c5d19b-da02-4737-8867-39745dfa5be8 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.829612 Jun 15 10:13:48.876508 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 36/62] 10.222.0.57 () {58 vars in 1169 bytes} [Wed Jun 15 10:13:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:48.882557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-825cbbaa-1408-4d5a-9adb-877186dd2087 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:48.883401 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-825cbbaa-1408-4d5a-9adb-877186dd2087 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:48.916274 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-30dc5904-9549-447d-a89b-5cca06281d00 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:48.921140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-825cbbaa-1408-4d5a-9adb-877186dd2087 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:48.922733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-825cbbaa-1408-4d5a-9adb-877186dd2087 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:48.936146 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-825cbbaa-1408-4d5a-9adb-877186dd2087 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:48.936146 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-825cbbaa-1408-4d5a-9adb-877186dd2087 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:48.937403 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-30dc5904-9549-447d-a89b-5cca06281d00 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.921286 Jun 15 10:13:48.939828 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 27/63] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:48 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:13:48.956583 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1a646251-3bfa-4186-afad-a7fd0a7e345f tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256b4cca0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:49.325424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1a646251-3bfa-4186-afad-a7fd0a7e345f tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.372655 Jun 15 10:13:49.326232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 28/64] 10.222.0.57 () {58 vars in 1154 bytes} [Wed Jun 15 10:13:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:49.337608 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4b075fb7-073b-40a3-98c9-9afff4927cc9 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe2573be1f0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:49.627172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-825cbbaa-1408-4d5a-9adb-877186dd2087 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:49.631964 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4b075fb7-073b-40a3-98c9-9afff4927cc9 tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.298065 Jun 15 10:13:49.632618 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 29/65] 10.222.0.57 () {58 vars in 1187 bytes} [Wed Jun 15 10:13:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:13:49.638765 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-825cbbaa-1408-4d5a-9adb-877186dd2087 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.759428 Jun 15 10:13:49.639369 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 37/66] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:48 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:49.645064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bbf55c38-7fc1-4781-acc2-b8fab23ae4cb tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] Calling method '.version_select at 0x7fe256b36820>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:49.857885 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bbf55c38-7fc1-4781-acc2-b8fab23ae4cb tempest-VolumesTestJSON-28488695 tempest-VolumesTestJSON-28488695-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.216757 Jun 15 10:13:49.858729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 30/67] 10.222.0.57 () {58 vars in 1154 bytes} [Wed Jun 15 10:13:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:13:49.961619 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bef27dba-d561-4c01-a2c3-f0f0e7408b19 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:49.962688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-159645371", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a926aae-ec26-461f-9351-b7dd3268c1ac"}], "security_groups": [{"name": "tempest-securitygroup--346290296"}], "key_name": "tempest-keypair-1213979694", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:13:49.963104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bef27dba-d561-4c01-a2c3-f0f0e7408b19 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:49.973356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bef27dba-d561-4c01-a2c3-f0f0e7408b19 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:49.974345 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bef27dba-d561-4c01-a2c3-f0f0e7408b19 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:49.975377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bef27dba-d561-4c01-a2c3-f0f0e7408b19 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:49.976344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bef27dba-d561-4c01-a2c3-f0f0e7408b19 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:50.146053 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] validate_networks() for [('1a926aae-ec26-461f-9351-b7dd3268c1ac', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:13:50.197909 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bef27dba-d561-4c01-a2c3-f0f0e7408b19 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:50.205762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bef27dba-d561-4c01-a2c3-f0f0e7408b19 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.248813 Jun 15 10:13:50.206657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 38/68] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:49 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:50.554676 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:13:50.555115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:13:50.555606 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:13:50.556023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:13:50.556470 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:13:50.565630 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:50.566085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:50.566926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:50.567370 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:50.584559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Getting quotas for project f30e2cce69fb4e9bba7c053c4a37ba07. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:13:50.588753 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Getting quotas for user 021e68642b0d4384bf3ece64e8e2ad69 and project f30e2cce69fb4e9bba7c053c4a37ba07. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:13:50.600383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:13:50.602677 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:13:50.656541 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-abf60abc-b6f2-4e6c-a99f-99cd0f3889ac tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.699477 Jun 15 10:13:50.657128 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8906e028-5a18-40db-b46c-8387b64465c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:50.657239 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 31/69] 10.222.0.57 () {62 vars in 1187 bytes} [Wed Jun 15 10:13:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 10:13:50.658103 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8906e028-5a18-40db-b46c-8387b64465c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:50.664507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8906e028-5a18-40db-b46c-8387b64465c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:50.665239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8906e028-5a18-40db-b46c-8387b64465c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:50.666288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8906e028-5a18-40db-b46c-8387b64465c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:50.666931 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8906e028-5a18-40db-b46c-8387b64465c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:50.670668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ca6bc887-d6b9-4770-8af4-2009a72e6511 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:50.671393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ca6bc887-d6b9-4770-8af4-2009a72e6511 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:50.776646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8906e028-5a18-40db-b46c-8387b64465c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:50.778820 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ca6bc887-d6b9-4770-8af4-2009a72e6511 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:50.792391 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ca6bc887-d6b9-4770-8af4-2009a72e6511 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:50.795423 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ca6bc887-d6b9-4770-8af4-2009a72e6511 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:50.796043 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8906e028-5a18-40db-b46c-8387b64465c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.143582 Jun 15 10:13:50.800000 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 39/70] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:50 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:50.809599 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ca6bc887-d6b9-4770-8af4-2009a72e6511 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1281 microversion: 2.20 time: 0.144464 Jun 15 10:13:50.811207 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 32/71] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:50 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:13:51.222333 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f71bfd6a-34e5-4468-95c7-d96080e21c80 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:51.222986 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f71bfd6a-34e5-4468-95c7-d96080e21c80 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:51.228741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f71bfd6a-34e5-4468-95c7-d96080e21c80 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:51.229195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f71bfd6a-34e5-4468-95c7-d96080e21c80 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:51.229951 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f71bfd6a-34e5-4468-95c7-d96080e21c80 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:51.230441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f71bfd6a-34e5-4468-95c7-d96080e21c80 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:51.375564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f71bfd6a-34e5-4468-95c7-d96080e21c80 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:51.382982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f71bfd6a-34e5-4468-95c7-d96080e21c80 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.164471 Jun 15 10:13:51.383552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 40/72] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:51 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:51.813413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1803cddb-e45f-460d-9c6d-31294af5d586 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:51.814055 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1803cddb-e45f-460d-9c6d-31294af5d586 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:51.820286 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1803cddb-e45f-460d-9c6d-31294af5d586 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:51.820951 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1803cddb-e45f-460d-9c6d-31294af5d586 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:51.821808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1803cddb-e45f-460d-9c6d-31294af5d586 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:51.822468 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1803cddb-e45f-460d-9c6d-31294af5d586 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:51.828390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:51.829306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:51.836169 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:51.836941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:51.837861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:51.838309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:51.896934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1803cddb-e45f-460d-9c6d-31294af5d586 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:51.908202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1803cddb-e45f-460d-9c6d-31294af5d586 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.098753 Jun 15 10:13:51.917693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 33/73] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:51 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:51.944229 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:51.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:51.954445 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:51.955539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-97766e11-3acf-4b46-a4c0-efc79a402ca8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.132274 Jun 15 10:13:51.956283 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 41/74] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:51 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:13:52.399863 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f2b54c71-1711-44c8-a94b-5ebf9d3d3c75 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:52.400492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f2b54c71-1711-44c8-a94b-5ebf9d3d3c75 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:52.407411 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f2b54c71-1711-44c8-a94b-5ebf9d3d3c75 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:52.407871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f2b54c71-1711-44c8-a94b-5ebf9d3d3c75 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:52.408652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f2b54c71-1711-44c8-a94b-5ebf9d3d3c75 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:52.409107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f2b54c71-1711-44c8-a94b-5ebf9d3d3c75 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:52.543284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f2b54c71-1711-44c8-a94b-5ebf9d3d3c75 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:52.551054 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f2b54c71-1711-44c8-a94b-5ebf9d3d3c75 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.155044 Jun 15 10:13:52.551623 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 34/75] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:52 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:52.924849 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cac4534f-2b80-433f-8c7a-58cbdd3bb03a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:52.925553 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cac4534f-2b80-433f-8c7a-58cbdd3bb03a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:52.931700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cac4534f-2b80-433f-8c7a-58cbdd3bb03a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:52.932154 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cac4534f-2b80-433f-8c7a-58cbdd3bb03a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:52.932918 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cac4534f-2b80-433f-8c7a-58cbdd3bb03a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:52.933937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cac4534f-2b80-433f-8c7a-58cbdd3bb03a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:52.973196 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:52.973811 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:52.975763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:52.982157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:52.982157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:52.982157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:52.982424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:52.986336 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=57 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:53.006252 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cac4534f-2b80-433f-8c7a-58cbdd3bb03a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:53.016755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cac4534f-2b80-433f-8c7a-58cbdd3bb03a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.095705 Jun 15 10:13:53.017341 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 42/76] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:52 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:53.084406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:53.093241 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:53.095010 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:53.096115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e4583795-6e14-4e75-80b7-2a7901bef416 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.126924 Jun 15 10:13:53.096816 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 35/77] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:52 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:13:53.568031 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-06c351e8-547d-45ac-be63-8ecb878ab427 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:53.568966 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-06c351e8-547d-45ac-be63-8ecb878ab427 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:53.575228 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06c351e8-547d-45ac-be63-8ecb878ab427 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:53.575799 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06c351e8-547d-45ac-be63-8ecb878ab427 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:53.576586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06c351e8-547d-45ac-be63-8ecb878ab427 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:53.580319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06c351e8-547d-45ac-be63-8ecb878ab427 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:53.757431 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-06c351e8-547d-45ac-be63-8ecb878ab427 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:53.759659 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=75 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:53.767381 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-06c351e8-547d-45ac-be63-8ecb878ab427 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.203328 Jun 15 10:13:53.768272 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 43/78] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:53 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:54.035746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-edec31ae-47d4-432d-80b2-d8e931ed1915 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:54.036361 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-edec31ae-47d4-432d-80b2-d8e931ed1915 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:54.043153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edec31ae-47d4-432d-80b2-d8e931ed1915 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:54.043694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edec31ae-47d4-432d-80b2-d8e931ed1915 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:54.044567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edec31ae-47d4-432d-80b2-d8e931ed1915 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:54.045012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edec31ae-47d4-432d-80b2-d8e931ed1915 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:54.115340 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:54.116607 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:54.120025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:54.127182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:54.127934 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:54.128955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:54.129605 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:54.161740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-edec31ae-47d4-432d-80b2-d8e931ed1915 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:54.177137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-edec31ae-47d4-432d-80b2-d8e931ed1915 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.146037 Jun 15 10:13:54.177744 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 36/79] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:54 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:54.241143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:54.256313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:54.258025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:54.260569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f0405bc5-fe4e-4685-84e2-d5e6ef5283bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.148933 Jun 15 10:13:54.261262 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 44/80] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:54 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:13:54.785295 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dd8e06cd-4a7c-4bc9-be20-f3f8e61037f8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:54.786543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dd8e06cd-4a7c-4bc9-be20-f3f8e61037f8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:54.799446 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd8e06cd-4a7c-4bc9-be20-f3f8e61037f8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:54.799842 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd8e06cd-4a7c-4bc9-be20-f3f8e61037f8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:54.800767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd8e06cd-4a7c-4bc9-be20-f3f8e61037f8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:54.801212 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd8e06cd-4a7c-4bc9-be20-f3f8e61037f8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:55.016537 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dd8e06cd-4a7c-4bc9-be20-f3f8e61037f8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:55.036981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dd8e06cd-4a7c-4bc9-be20-f3f8e61037f8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.256426 Jun 15 10:13:55.037638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 37/81] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:54 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:55.194829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4322e7b7-8b79-4d69-8895-89e2843fea68 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:55.196069 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4322e7b7-8b79-4d69-8895-89e2843fea68 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:55.202641 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:55.204652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4322e7b7-8b79-4d69-8895-89e2843fea68 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:55.205500 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4322e7b7-8b79-4d69-8895-89e2843fea68 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:55.206770 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4322e7b7-8b79-4d69-8895-89e2843fea68 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:55.207467 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4322e7b7-8b79-4d69-8895-89e2843fea68 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:55.284167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:55.284813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:55.297697 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:55.298859 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:55.300570 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:55.301029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:55.349203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4322e7b7-8b79-4d69-8895-89e2843fea68 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:55.356840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4322e7b7-8b79-4d69-8895-89e2843fea68 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.166184 Jun 15 10:13:55.357845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 45/82] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:55 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:55.392355 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:55.428265 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:55.435200 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:55.436539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3ad284c4-3593-4040-8bdf-ceb1bfe2d8df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.160858 Jun 15 10:13:55.441302 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 38/83] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:55 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:13:56.058127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a63af258-ff49-4b1a-814b-15c0251deac2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:56.059418 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a63af258-ff49-4b1a-814b-15c0251deac2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:56.061710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=14 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:13:56.068575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a63af258-ff49-4b1a-814b-15c0251deac2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:56.069592 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a63af258-ff49-4b1a-814b-15c0251deac2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:56.070723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a63af258-ff49-4b1a-814b-15c0251deac2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:56.071361 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a63af258-ff49-4b1a-814b-15c0251deac2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:56.264730 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a63af258-ff49-4b1a-814b-15c0251deac2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:56.286208 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a63af258-ff49-4b1a-814b-15c0251deac2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.233024 Jun 15 10:13:56.286833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 46/84] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:56 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:56.376039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-da025cd1-388a-4624-8aab-fb0cb0f4dad0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:56.376679 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-da025cd1-388a-4624-8aab-fb0cb0f4dad0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:56.382856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-da025cd1-388a-4624-8aab-fb0cb0f4dad0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:56.383480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-da025cd1-388a-4624-8aab-fb0cb0f4dad0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:56.384737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-da025cd1-388a-4624-8aab-fb0cb0f4dad0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:56.386805 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-da025cd1-388a-4624-8aab-fb0cb0f4dad0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:56.455711 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-da025cd1-388a-4624-8aab-fb0cb0f4dad0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:56.461219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:56.461922 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:56.462021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-da025cd1-388a-4624-8aab-fb0cb0f4dad0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.091351 Jun 15 10:13:56.462726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 39/85] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:56 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:56.468704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:56.469490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:56.470095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:56.470622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:56.542032 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:56.551239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:56.553094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:56.554381 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-90410c86-0c5a-40b9-85a2-c2c83a4d3f43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.097383 Jun 15 10:13:56.555420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 47/86] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:56 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:13:57.304347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-95300b44-a0a2-488d-bd43-cca339540afc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:57.305185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-95300b44-a0a2-488d-bd43-cca339540afc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:57.312578 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95300b44-a0a2-488d-bd43-cca339540afc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:57.313109 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95300b44-a0a2-488d-bd43-cca339540afc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:57.313950 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95300b44-a0a2-488d-bd43-cca339540afc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:57.314570 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95300b44-a0a2-488d-bd43-cca339540afc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:57.477703 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-824cb7f5-1ac2-425f-be0c-56b72a80d211 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:57.478510 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-824cb7f5-1ac2-425f-be0c-56b72a80d211 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:57.484428 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-824cb7f5-1ac2-425f-be0c-56b72a80d211 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:57.485126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-824cb7f5-1ac2-425f-be0c-56b72a80d211 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:57.485884 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-824cb7f5-1ac2-425f-be0c-56b72a80d211 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:57.486333 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-824cb7f5-1ac2-425f-be0c-56b72a80d211 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:57.595418 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-824cb7f5-1ac2-425f-be0c-56b72a80d211 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:57.606205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-824cb7f5-1ac2-425f-be0c-56b72a80d211 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.132098 Jun 15 10:13:57.606415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-95300b44-a0a2-488d-bd43-cca339540afc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:57.607374 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 48/87] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:57 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:13:57.617185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-95300b44-a0a2-488d-bd43-cca339540afc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.316773 Jun 15 10:13:57.618548 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 40/88] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:57 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:57.629509 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:57.630163 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:57.636909 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:57.637427 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:57.638434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:57.638874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:57.716733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:57.725412 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:57.727098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:57.728178 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b654a0f8-bc7f-4873-ac02-402d3d4c4bb1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.119877 Jun 15 10:13:57.728735 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 49/89] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:57 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:13:58.625999 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e97e32b7-ec0c-49f8-b3d5-45e1e45563ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:58.626641 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e97e32b7-ec0c-49f8-b3d5-45e1e45563ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:58.634071 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e97e32b7-ec0c-49f8-b3d5-45e1e45563ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:58.634639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e97e32b7-ec0c-49f8-b3d5-45e1e45563ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:58.635624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e97e32b7-ec0c-49f8-b3d5-45e1e45563ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:58.635812 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2a1646b3-0bd7-4d2e-adff-2697a7fa255b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:58.636849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e97e32b7-ec0c-49f8-b3d5-45e1e45563ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:58.637903 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2a1646b3-0bd7-4d2e-adff-2697a7fa255b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:58.647407 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a1646b3-0bd7-4d2e-adff-2697a7fa255b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:58.648006 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a1646b3-0bd7-4d2e-adff-2697a7fa255b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:58.648941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a1646b3-0bd7-4d2e-adff-2697a7fa255b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:58.649514 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a1646b3-0bd7-4d2e-adff-2697a7fa255b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:58.725095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e97e32b7-ec0c-49f8-b3d5-45e1e45563ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:58.733031 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e97e32b7-ec0c-49f8-b3d5-45e1e45563ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.113050 Jun 15 10:13:58.733780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 41/90] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:58 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:13:58.750772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:58.751719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:58.758681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:58.759371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:58.760440 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:58.760983 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:58.852819 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:58.857638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2a1646b3-0bd7-4d2e-adff-2697a7fa255b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:58.867305 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2a1646b3-0bd7-4d2e-adff-2697a7fa255b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.235564 Jun 15 10:13:58.867885 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 50/91] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:58 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:13:58.879679 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:58.881570 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:58.882806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7c38331f-acbe-41f7-bf24-27611e85f220 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.138373 Jun 15 10:13:58.883650 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 42/92] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:58 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:13:59.751287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-27e5db12-6cda-43df-b0ae-104dbf070fc3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:59.751912 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-27e5db12-6cda-43df-b0ae-104dbf070fc3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:59.758213 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27e5db12-6cda-43df-b0ae-104dbf070fc3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:59.758914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27e5db12-6cda-43df-b0ae-104dbf070fc3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:59.759782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27e5db12-6cda-43df-b0ae-104dbf070fc3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:59.760369 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27e5db12-6cda-43df-b0ae-104dbf070fc3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:59.825493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-27e5db12-6cda-43df-b0ae-104dbf070fc3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:13:59.837237 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-27e5db12-6cda-43df-b0ae-104dbf070fc3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.089860 Jun 15 10:13:59.837828 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 51/93] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:59 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:13:59.885389 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3b5a214b-da5e-44e8-8811-63207cb82157 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:59.887128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3b5a214b-da5e-44e8-8811-63207cb82157 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:59.894086 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b5a214b-da5e-44e8-8811-63207cb82157 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:59.894732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b5a214b-da5e-44e8-8811-63207cb82157 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:59.909888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:13:59.910986 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:13:59.916854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b5a214b-da5e-44e8-8811-63207cb82157 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:59.917318 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b5a214b-da5e-44e8-8811-63207cb82157 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:59.919857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:59.920315 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:13:59.921090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:13:59.921524 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:00.055902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:00.072015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:00.080308 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:00.082995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bed7ba5f-3955-42fe-a91f-70b1f4859ea4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.185863 Jun 15 10:14:00.086897 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 52/94] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:13:59 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:00.129138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b5a214b-da5e-44e8-8811-63207cb82157 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:00.136566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3b5a214b-da5e-44e8-8811-63207cb82157 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.255352 Jun 15 10:14:00.137163 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 43/95] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:13:59 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:00.872736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3323f65a-d9d4-4d09-bf96-81687608f277 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:00.874961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3323f65a-d9d4-4d09-bf96-81687608f277 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:00.883147 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3323f65a-d9d4-4d09-bf96-81687608f277 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:00.883611 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3323f65a-d9d4-4d09-bf96-81687608f277 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:00.884390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3323f65a-d9d4-4d09-bf96-81687608f277 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:00.884829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3323f65a-d9d4-4d09-bf96-81687608f277 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:00.975457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3323f65a-d9d4-4d09-bf96-81687608f277 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:00.984201 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3323f65a-d9d4-4d09-bf96-81687608f277 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.126537 Jun 15 10:14:00.985028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 53/96] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:00 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:01.108193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:01.109394 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:01.116165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:01.118429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=16 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:01.121495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:01.122849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:01.123998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:01.124738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:01.153490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-902c5df4-6de6-4af9-9817-59b7b5d2c75f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:01.154447 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-902c5df4-6de6-4af9-9817-59b7b5d2c75f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:01.167565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-902c5df4-6de6-4af9-9817-59b7b5d2c75f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:01.168626 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-902c5df4-6de6-4af9-9817-59b7b5d2c75f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:01.169720 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-902c5df4-6de6-4af9-9817-59b7b5d2c75f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:01.170799 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-902c5df4-6de6-4af9-9817-59b7b5d2c75f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:01.269840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:01.283866 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:01.286050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:01.288944 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-696f9efe-89be-4ab2-9c71-d50623e5b48f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1285 microversion: 2.20 time: 0.185551 Jun 15 10:14:01.293956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 44/97] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:01 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:01.482359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-902c5df4-6de6-4af9-9817-59b7b5d2c75f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:01.498528 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-902c5df4-6de6-4af9-9817-59b7b5d2c75f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.346498 Jun 15 10:14:01.512915 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 54/98] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:01 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:02.003402 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0114e2c7-3884-4257-82b1-c482fb307f38 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:02.004230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0114e2c7-3884-4257-82b1-c482fb307f38 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:02.011340 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0114e2c7-3884-4257-82b1-c482fb307f38 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.011986 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0114e2c7-3884-4257-82b1-c482fb307f38 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.012960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0114e2c7-3884-4257-82b1-c482fb307f38 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.013611 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0114e2c7-3884-4257-82b1-c482fb307f38 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.120971 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0114e2c7-3884-4257-82b1-c482fb307f38 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:02.138000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0114e2c7-3884-4257-82b1-c482fb307f38 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1279 microversion: 2.1 time: 0.137107 Jun 15 10:14:02.139491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 45/99] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:01 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1279 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:02.154921 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-00104b79-cc30-4696-b66d-4c9f6fe84fd0 req-241245ce-c788-4dd2-a633-9222c990e12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea751c2f-c929-4939-b72c-70a5487bba0a", "tag": "f8d02131-5cb5-405d-8ed7-13f30cd0921e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:02.169206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-00104b79-cc30-4696-b66d-4c9f6fe84fd0 req-241245ce-c788-4dd2-a633-9222c990e12d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.178718 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-00104b79-cc30-4696-b66d-4c9f6fe84fd0 req-241245ce-c788-4dd2-a633-9222c990e12d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.219153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-00104b79-cc30-4696-b66d-4c9f6fe84fd0 req-241245ce-c788-4dd2-a633-9222c990e12d service nova] Creating event network-changed:f8d02131-5cb5-405d-8ed7-13f30cd0921e for instance ea751c2f-c929-4939-b72c-70a5487bba0a on hv-cinder-83028 Jun 15 10:14:02.220129 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-00104b79-cc30-4696-b66d-4c9f6fe84fd0 req-241245ce-c788-4dd2-a633-9222c990e12d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 10:14:02.222377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c186809-be73-413a-8b8b-37f5dbf818a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.222857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c186809-be73-413a-8b8b-37f5dbf818a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.223681 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c186809-be73-413a-8b8b-37f5dbf818a1 None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.224120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c186809-be73-413a-8b8b-37f5dbf818a1 None None] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.242797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.compute.rpcapi [None req-5c186809-be73-413a-8b8b-37f5dbf818a1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 10:14:02.247770 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c186809-be73-413a-8b8b-37f5dbf818a1 None None] Releasing lock "compute-rpcapi-router" {{(pid=117721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 10:14:02.293051 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5c186809-be73-413a-8b8b-37f5dbf818a1 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141659 Jun 15 10:14:02.294564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 55/100] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:02.314646 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:02.315459 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:02.327785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.328347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.329671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.330219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.407874 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:02.417325 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:02.419381 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:02.420498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7b3025d8-f13b-4270-b6ca-6cbe6430ffbc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1333 microversion: 2.20 time: 0.110872 Jun 15 10:14:02.421141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 46/101] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:02 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1333 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:02.524293 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-250ce31a-dbce-42cc-b802-2acc8be6210b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:02.525197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-250ce31a-dbce-42cc-b802-2acc8be6210b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:02.533397 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-250ce31a-dbce-42cc-b802-2acc8be6210b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.534392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-250ce31a-dbce-42cc-b802-2acc8be6210b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.535340 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-250ce31a-dbce-42cc-b802-2acc8be6210b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:02.536257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-250ce31a-dbce-42cc-b802-2acc8be6210b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:02.703490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-250ce31a-dbce-42cc-b802-2acc8be6210b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:02.710972 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-250ce31a-dbce-42cc-b802-2acc8be6210b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.199499 Jun 15 10:14:02.713217 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 56/102] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:02 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:03.155660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5607942e-9609-462e-bf18-6a125e813131 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:03.156275 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5607942e-9609-462e-bf18-6a125e813131 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:03.163527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5607942e-9609-462e-bf18-6a125e813131 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:03.163527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5607942e-9609-462e-bf18-6a125e813131 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:03.163527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5607942e-9609-462e-bf18-6a125e813131 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:03.163972 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5607942e-9609-462e-bf18-6a125e813131 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:03.306371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5607942e-9609-462e-bf18-6a125e813131 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:03.315413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5607942e-9609-462e-bf18-6a125e813131 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.164674 Jun 15 10:14:03.315996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 47/103] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:03 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:03.439795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:03.440989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:03.447232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:03.447850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:03.449336 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:03.449895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:03.512050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:03.519813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:03.521320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:03.522466 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-af62c356-0411-4755-a691-85282d6b04c0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1333 microversion: 2.20 time: 0.086852 Jun 15 10:14:03.523032 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 57/104] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:03 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:03.728503 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-452bb90f-30a1-41dd-9955-fecf339805b8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:03.729157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-452bb90f-30a1-41dd-9955-fecf339805b8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:03.736989 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-452bb90f-30a1-41dd-9955-fecf339805b8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:03.737442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-452bb90f-30a1-41dd-9955-fecf339805b8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:03.738344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-452bb90f-30a1-41dd-9955-fecf339805b8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:03.738974 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-452bb90f-30a1-41dd-9955-fecf339805b8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:03.923582 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-452bb90f-30a1-41dd-9955-fecf339805b8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:03.931479 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-452bb90f-30a1-41dd-9955-fecf339805b8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.207111 Jun 15 10:14:03.941998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 48/105] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:03 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:04.333704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7dcba128-e0e1-435b-905f-0b70d14c5b18 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:04.334346 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7dcba128-e0e1-435b-905f-0b70d14c5b18 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:04.340403 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7dcba128-e0e1-435b-905f-0b70d14c5b18 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:04.340856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7dcba128-e0e1-435b-905f-0b70d14c5b18 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:04.341625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7dcba128-e0e1-435b-905f-0b70d14c5b18 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:04.342106 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7dcba128-e0e1-435b-905f-0b70d14c5b18 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:04.477797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7dcba128-e0e1-435b-905f-0b70d14c5b18 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:04.486407 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7dcba128-e0e1-435b-905f-0b70d14c5b18 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.156479 Jun 15 10:14:04.491142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 58/106] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:04 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:04.540418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:04.541028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:04.547624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:04.548071 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:04.548822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:04.549259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:04.614471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:04.623669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:04.625211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:04.626357 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-739965e0-a82c-41ad-9f08-bc705fad1c00 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1333 microversion: 2.20 time: 0.089727 Jun 15 10:14:04.626922 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 49/107] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:04 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:04.949668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-720034ac-1543-42f2-a276-8c1269b7a63b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:04.950610 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-720034ac-1543-42f2-a276-8c1269b7a63b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:04.957191 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-720034ac-1543-42f2-a276-8c1269b7a63b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:04.957777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-720034ac-1543-42f2-a276-8c1269b7a63b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:04.958785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-720034ac-1543-42f2-a276-8c1269b7a63b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:04.959224 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-720034ac-1543-42f2-a276-8c1269b7a63b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:05.182316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-720034ac-1543-42f2-a276-8c1269b7a63b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:05.191010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-720034ac-1543-42f2-a276-8c1269b7a63b tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.245711 Jun 15 10:14:05.191798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 59/108] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:04 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:05.503552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd0206bf-4985-4d53-bdd8-87cca6eee4df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:05.504172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd0206bf-4985-4d53-bdd8-87cca6eee4df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:05.510519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd0206bf-4985-4d53-bdd8-87cca6eee4df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:05.511548 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd0206bf-4985-4d53-bdd8-87cca6eee4df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:05.512320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd0206bf-4985-4d53-bdd8-87cca6eee4df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:05.513110 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd0206bf-4985-4d53-bdd8-87cca6eee4df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:05.644421 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:05.645627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:05.647772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd0206bf-4985-4d53-bdd8-87cca6eee4df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:05.653148 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:05.653804 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:05.654613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:05.655050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:05.655656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd0206bf-4985-4d53-bdd8-87cca6eee4df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.155869 Jun 15 10:14:05.656241 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 50/109] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:05 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:05.717442 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:05.719645 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:05.726686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:05.728226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:05.729330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-839e4634-dbe5-4341-bff6-3a695091185d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1333 microversion: 2.20 time: 0.089589 Jun 15 10:14:05.730740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 60/110] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:05 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:06.223167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2e9d91a8-b631-4b8e-92cb-bfde54f7538e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:06.224301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2e9d91a8-b631-4b8e-92cb-bfde54f7538e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:06.232793 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e9d91a8-b631-4b8e-92cb-bfde54f7538e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:06.233511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e9d91a8-b631-4b8e-92cb-bfde54f7538e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:06.236359 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e9d91a8-b631-4b8e-92cb-bfde54f7538e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:06.236983 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e9d91a8-b631-4b8e-92cb-bfde54f7538e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:06.494613 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2e9d91a8-b631-4b8e-92cb-bfde54f7538e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:06.497420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:06.505765 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2e9d91a8-b631-4b8e-92cb-bfde54f7538e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.296279 Jun 15 10:14:06.506629 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 51/111] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:06 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:06.676502 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-27673e39-a3cf-4a25-be1d-250fce17e68b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:06.677794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-27673e39-a3cf-4a25-be1d-250fce17e68b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:06.684847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27673e39-a3cf-4a25-be1d-250fce17e68b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:06.685495 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27673e39-a3cf-4a25-be1d-250fce17e68b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:06.686292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27673e39-a3cf-4a25-be1d-250fce17e68b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:06.686735 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-27673e39-a3cf-4a25-be1d-250fce17e68b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:06.748282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:06.748878 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:06.756759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:06.757206 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:06.762442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:06.763884 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:06.888337 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:06.899517 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:06.901395 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:06.903721 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-610b3ecd-23fc-4a2a-b228-f052f6fbe29c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1333 microversion: 2.20 time: 0.159205 Jun 15 10:14:06.905926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-27673e39-a3cf-4a25-be1d-250fce17e68b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:06.915299 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 52/112] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:06 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1333 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:06.921019 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-27673e39-a3cf-4a25-be1d-250fce17e68b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.250398 Jun 15 10:14:06.921740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 61/113] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:06 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:07.526024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0f61b26a-a62e-407a-8c12-69b51d2cdb72 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:07.526766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0f61b26a-a62e-407a-8c12-69b51d2cdb72 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:07.533805 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f61b26a-a62e-407a-8c12-69b51d2cdb72 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:07.534685 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f61b26a-a62e-407a-8c12-69b51d2cdb72 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:07.535686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f61b26a-a62e-407a-8c12-69b51d2cdb72 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:07.537287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0f61b26a-a62e-407a-8c12-69b51d2cdb72 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:07.675282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0f61b26a-a62e-407a-8c12-69b51d2cdb72 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:07.683049 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0f61b26a-a62e-407a-8c12-69b51d2cdb72 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.161877 Jun 15 10:14:07.683682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 53/114] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:07 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:07.922796 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:07.923999 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:07.930093 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:07.930685 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:07.931464 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:07.931907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:07.938312 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-73195d44-aad1-4a3f-aaf9-fc394a637a6e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:07.939036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-73195d44-aad1-4a3f-aaf9-fc394a637a6e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:07.945518 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-73195d44-aad1-4a3f-aaf9-fc394a637a6e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:07.946033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-73195d44-aad1-4a3f-aaf9-fc394a637a6e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:07.946935 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-73195d44-aad1-4a3f-aaf9-fc394a637a6e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:07.947433 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-73195d44-aad1-4a3f-aaf9-fc394a637a6e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:08.021140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:08.030786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:08.032451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:08.033676 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1bc38bfc-95c3-452b-81bd-6460f44b101f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1333 microversion: 2.20 time: 0.114785 Jun 15 10:14:08.045508 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 62/115] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:07 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1333 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:08.119303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-73195d44-aad1-4a3f-aaf9-fc394a637a6e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:08.126787 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-73195d44-aad1-4a3f-aaf9-fc394a637a6e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.192487 Jun 15 10:14:08.127442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 54/116] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:07 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:08.702668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0c83f432-a394-435c-bcdd-3871f5d3b2bb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:08.703380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0c83f432-a394-435c-bcdd-3871f5d3b2bb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:08.715800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c83f432-a394-435c-bcdd-3871f5d3b2bb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:08.716277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c83f432-a394-435c-bcdd-3871f5d3b2bb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:08.718873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c83f432-a394-435c-bcdd-3871f5d3b2bb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:08.720378 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c83f432-a394-435c-bcdd-3871f5d3b2bb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:08.872180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0c83f432-a394-435c-bcdd-3871f5d3b2bb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:08.881104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0c83f432-a394-435c-bcdd-3871f5d3b2bb tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.183967 Jun 15 10:14:08.881654 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 63/117] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:08 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:09.053038 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:09.053812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:09.062411 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:09.063030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:09.063909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:09.064447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:09.148490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cfee596b-56af-4aeb-a31a-953ba2b7cd04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:09.151115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cfee596b-56af-4aeb-a31a-953ba2b7cd04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:09.169580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:09.176517 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfee596b-56af-4aeb-a31a-953ba2b7cd04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:09.177319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfee596b-56af-4aeb-a31a-953ba2b7cd04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:09.181320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfee596b-56af-4aeb-a31a-953ba2b7cd04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:09.184885 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfee596b-56af-4aeb-a31a-953ba2b7cd04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:09.192832 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:09.198492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:09.201997 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4e557a3c-42f3-4751-ac36-ae2e5890bba7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1333 microversion: 2.20 time: 0.151848 Jun 15 10:14:09.203675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 55/118] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:09 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1333 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:09.392662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cfee596b-56af-4aeb-a31a-953ba2b7cd04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:09.400280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cfee596b-56af-4aeb-a31a-953ba2b7cd04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.258706 Jun 15 10:14:09.401003 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 64/119] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:09 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:09.898236 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8082f5af-8022-442c-8fde-f43e45604f8c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:09.899040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8082f5af-8022-442c-8fde-f43e45604f8c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:09.918535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8082f5af-8022-442c-8fde-f43e45604f8c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:09.918535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8082f5af-8022-442c-8fde-f43e45604f8c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:09.918535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8082f5af-8022-442c-8fde-f43e45604f8c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:09.918535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8082f5af-8022-442c-8fde-f43e45604f8c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:10.183747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8082f5af-8022-442c-8fde-f43e45604f8c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:10.194198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8082f5af-8022-442c-8fde-f43e45604f8c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.297471 Jun 15 10:14:10.195330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 56/120] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:09 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:10.223456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:10.227361 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:10.238356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:10.239152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:10.240710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:10.242752 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:10.361760 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:10.378183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:10.380179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:10.385261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eca8629d-4c85-4a34-a0d0-b2a5953a2423 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1339 microversion: 2.20 time: 0.163569 Jun 15 10:14:10.400649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 65/121] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:10 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:10.420061 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-29b8967f-329f-495a-8ba1-5c70c24835b8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:10.420900 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-29b8967f-329f-495a-8ba1-5c70c24835b8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:10.442974 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-29b8967f-329f-495a-8ba1-5c70c24835b8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:10.446859 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-29b8967f-329f-495a-8ba1-5c70c24835b8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:10.447678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-29b8967f-329f-495a-8ba1-5c70c24835b8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:10.448225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-29b8967f-329f-495a-8ba1-5c70c24835b8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:10.875857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-29b8967f-329f-495a-8ba1-5c70c24835b8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:10.893233 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-29b8967f-329f-495a-8ba1-5c70c24835b8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.478584 Jun 15 10:14:10.893838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 57/122] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:10 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:11.212660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-083312a2-98d8-4621-a1a7-681b225a876c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:11.213278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-083312a2-98d8-4621-a1a7-681b225a876c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:11.226784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-083312a2-98d8-4621-a1a7-681b225a876c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:11.227433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-083312a2-98d8-4621-a1a7-681b225a876c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:11.228006 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-083312a2-98d8-4621-a1a7-681b225a876c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:11.228442 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-083312a2-98d8-4621-a1a7-681b225a876c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:11.405820 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:11.406544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:11.415797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:11.416513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:11.417368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:11.418726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:11.749722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-083312a2-98d8-4621-a1a7-681b225a876c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:11.758003 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-083312a2-98d8-4621-a1a7-681b225a876c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.550118 Jun 15 10:14:11.761634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 66/123] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:11 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:11.838700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:11.851878 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:11.853732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:11.856798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2c92d42f-65b6-412f-b70d-371619c46dae tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.455851 Jun 15 10:14:11.869406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 58/124] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:11 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:11.912052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9d2f68a0-da0d-4f87-b654-e72ed15bea95 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:11.913016 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9d2f68a0-da0d-4f87-b654-e72ed15bea95 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:11.920518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9d2f68a0-da0d-4f87-b654-e72ed15bea95 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:11.921478 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9d2f68a0-da0d-4f87-b654-e72ed15bea95 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:11.922751 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9d2f68a0-da0d-4f87-b654-e72ed15bea95 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:11.923905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9d2f68a0-da0d-4f87-b654-e72ed15bea95 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:11.953151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-d76f8878-96c0-44f6-bbc8-e9edcf4f2e15 req-1fa5df78-f47c-4079-864c-50a2b5afa5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf", "tag": "46ca2b51-7c1c-444b-8134-9d5e61874f98"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:11.964254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-d76f8878-96c0-44f6-bbc8-e9edcf4f2e15 req-1fa5df78-f47c-4079-864c-50a2b5afa5d9 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:11.982327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-d76f8878-96c0-44f6-bbc8-e9edcf4f2e15 req-1fa5df78-f47c-4079-864c-50a2b5afa5d9 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:12.019353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-d76f8878-96c0-44f6-bbc8-e9edcf4f2e15 req-1fa5df78-f47c-4079-864c-50a2b5afa5d9 service nova] Creating event network-changed:46ca2b51-7c1c-444b-8134-9d5e61874f98 for instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf on hv-cinder-83028 Jun 15 10:14:12.025589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-d76f8878-96c0-44f6-bbc8-e9edcf4f2e15 req-1fa5df78-f47c-4079-864c-50a2b5afa5d9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076788 Jun 15 10:14:12.030081 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 59/125] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:12.222216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9d2f68a0-da0d-4f87-b654-e72ed15bea95 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:12.238765 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9d2f68a0-da0d-4f87-b654-e72ed15bea95 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.330230 Jun 15 10:14:12.240838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 67/126] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:11 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:12.780379 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-02941726-2e4e-41db-9582-a27934e2d909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:12.781085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-02941726-2e4e-41db-9582-a27934e2d909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:12.793049 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-02941726-2e4e-41db-9582-a27934e2d909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:12.793524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-02941726-2e4e-41db-9582-a27934e2d909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:12.794343 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-02941726-2e4e-41db-9582-a27934e2d909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:12.794785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-02941726-2e4e-41db-9582-a27934e2d909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:12.876419 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:12.877096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:12.883053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:12.884616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:12.885064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:12.891440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:12.892268 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:13.118452 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-02941726-2e4e-41db-9582-a27934e2d909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:13.132126 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-02941726-2e4e-41db-9582-a27934e2d909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.356971 Jun 15 10:14:13.133139 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 60/127] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:12 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:13.153904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:13.165444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:13.167332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:13.168830 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bb574daf-8dd5-4e4e-9bb3-6f05996bde96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.296409 Jun 15 10:14:13.179796 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 68/128] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:12 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:13.256793 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f27b1ba9-13ab-42c9-9858-5e5e53e226c4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:13.257530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f27b1ba9-13ab-42c9-9858-5e5e53e226c4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:13.266088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f27b1ba9-13ab-42c9-9858-5e5e53e226c4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:13.266764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f27b1ba9-13ab-42c9-9858-5e5e53e226c4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:13.267435 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f27b1ba9-13ab-42c9-9858-5e5e53e226c4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:13.278670 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f27b1ba9-13ab-42c9-9858-5e5e53e226c4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:13.429859 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f27b1ba9-13ab-42c9-9858-5e5e53e226c4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:13.438507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f27b1ba9-13ab-42c9-9858-5e5e53e226c4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.186174 Jun 15 10:14:13.439298 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 61/129] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:13 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:14.149087 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-681f4b1d-8d69-4906-98c9-c9215527b0a0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:14.149693 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-681f4b1d-8d69-4906-98c9-c9215527b0a0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:14.156714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-681f4b1d-8d69-4906-98c9-c9215527b0a0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:14.157160 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-681f4b1d-8d69-4906-98c9-c9215527b0a0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:14.157922 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-681f4b1d-8d69-4906-98c9-c9215527b0a0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:14.158377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-681f4b1d-8d69-4906-98c9-c9215527b0a0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:14.187067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:14.188372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:14.195998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:14.196412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:14.200723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:14.201323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:14.410243 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-681f4b1d-8d69-4906-98c9-c9215527b0a0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:14.414051 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:14.418604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-681f4b1d-8d69-4906-98c9-c9215527b0a0 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.273196 Jun 15 10:14:14.419857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 69/130] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:14 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:14.427659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:14.429400 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:14.430818 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cca88f69-0248-4e21-9e05-b935b970b207 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.247378 Jun 15 10:14:14.431371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 62/131] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:14 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:14.455895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3c74879a-2185-499d-b890-40346782ab20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:14.456460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3c74879a-2185-499d-b890-40346782ab20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:14.462320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3c74879a-2185-499d-b890-40346782ab20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:14.463013 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3c74879a-2185-499d-b890-40346782ab20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:14.463834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3c74879a-2185-499d-b890-40346782ab20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:14.464373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3c74879a-2185-499d-b890-40346782ab20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:14.757309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3c74879a-2185-499d-b890-40346782ab20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:14.767004 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3c74879a-2185-499d-b890-40346782ab20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.314969 Jun 15 10:14:14.769039 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 70/132] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:14 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:15.436977 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0b40ea60-849c-4382-9bf7-a31a1bdca305 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:15.437603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0b40ea60-849c-4382-9bf7-a31a1bdca305 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:15.449786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:15.451919 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:15.465778 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b40ea60-849c-4382-9bf7-a31a1bdca305 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:15.466239 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b40ea60-849c-4382-9bf7-a31a1bdca305 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:15.468578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:15.470716 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b40ea60-849c-4382-9bf7-a31a1bdca305 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:15.471239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:15.474103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b40ea60-849c-4382-9bf7-a31a1bdca305 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:15.476237 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:15.476883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:15.971509 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:15.993622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:15.997625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:15.998829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b0b17c13-6329-4abb-b4fd-700994183773 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.553418 Jun 15 10:14:16.004506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 71/133] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:15 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:16.009315 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0038b2ce-a714-412c-8139-a0939eca6e4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:16.009971 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0038b2ce-a714-412c-8139-a0939eca6e4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:16.015897 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0b40ea60-849c-4382-9bf7-a31a1bdca305 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:16.021872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0038b2ce-a714-412c-8139-a0939eca6e4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:16.024084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0b40ea60-849c-4382-9bf7-a31a1bdca305 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.592287 Jun 15 10:14:16.033624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 63/134] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:15 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:16.040349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0038b2ce-a714-412c-8139-a0939eca6e4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:16.043683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0038b2ce-a714-412c-8139-a0939eca6e4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:16.046189 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0038b2ce-a714-412c-8139-a0939eca6e4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:16.404048 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0038b2ce-a714-412c-8139-a0939eca6e4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:16.416241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0038b2ce-a714-412c-8139-a0939eca6e4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.409541 Jun 15 10:14:16.417861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 72/135] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:16 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:16.594759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-523b65e0-d146-4b90-a1b2-5af5e3368722 req-09bb9bb9-8d45-4439-85a1-ca240f1e4bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af5ab626-a7eb-407e-b8a9-a768e57d4022", "tag": "2021b47d-9010-4d70-8020-0269285a0559"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:16.604484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-523b65e0-d146-4b90-a1b2-5af5e3368722 req-09bb9bb9-8d45-4439-85a1-ca240f1e4bac service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:16.604996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-523b65e0-d146-4b90-a1b2-5af5e3368722 req-09bb9bb9-8d45-4439-85a1-ca240f1e4bac service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:16.616049 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-523b65e0-d146-4b90-a1b2-5af5e3368722 req-09bb9bb9-8d45-4439-85a1-ca240f1e4bac service nova] Creating event network-changed:2021b47d-9010-4d70-8020-0269285a0559 for instance af5ab626-a7eb-407e-b8a9-a768e57d4022 on hv-cinder-83028 Jun 15 10:14:16.622088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-523b65e0-d146-4b90-a1b2-5af5e3368722 req-09bb9bb9-8d45-4439-85a1-ca240f1e4bac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100739 Jun 15 10:14:16.622640 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 64/136] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:17.019958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:17.023254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:17.033262 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:17.033914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:17.035465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:17.036055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:17.041405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9a6953b8-9fde-43a7-852b-fd0273f63cd8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:17.042641 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9a6953b8-9fde-43a7-852b-fd0273f63cd8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:17.054490 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a6953b8-9fde-43a7-852b-fd0273f63cd8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:17.057961 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a6953b8-9fde-43a7-852b-fd0273f63cd8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:17.058964 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a6953b8-9fde-43a7-852b-fd0273f63cd8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:17.060276 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a6953b8-9fde-43a7-852b-fd0273f63cd8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:17.319399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:17.332912 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:17.334961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:17.336425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5ee61dc1-c0dd-4dbb-9b55-46980e0135f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.322095 Jun 15 10:14:17.336756 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9a6953b8-9fde-43a7-852b-fd0273f63cd8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:17.337166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 73/137] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:17 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:17.346248 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9a6953b8-9fde-43a7-852b-fd0273f63cd8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.308945 Jun 15 10:14:17.347203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 65/138] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:17 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:17.428861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-5ae9173a-3fa8-49b8-8743-80c2aef72238 req-6bd661c5-0e5e-44b6-a856-42fba8adb756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a", "name": "network-vif-plugged", "status": "completed", "tag": "4f233b8f-c4be-4757-8284-4c4bc12427d9"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:17.440122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ec31a832-3ee3-4748-a7da-a6f69a6cb413 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:17.440759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ec31a832-3ee3-4748-a7da-a6f69a6cb413 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:17.448336 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec31a832-3ee3-4748-a7da-a6f69a6cb413 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:17.449076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec31a832-3ee3-4748-a7da-a6f69a6cb413 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:17.450203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec31a832-3ee3-4748-a7da-a6f69a6cb413 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:17.450860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec31a832-3ee3-4748-a7da-a6f69a6cb413 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:17.452567 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-5ae9173a-3fa8-49b8-8743-80c2aef72238 req-6bd661c5-0e5e-44b6-a856-42fba8adb756 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:17.455773 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-5ae9173a-3fa8-49b8-8743-80c2aef72238 req-6bd661c5-0e5e-44b6-a856-42fba8adb756 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:17.486019 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-5ae9173a-3fa8-49b8-8743-80c2aef72238 req-6bd661c5-0e5e-44b6-a856-42fba8adb756 service nova] Creating event network-vif-plugged:4f233b8f-c4be-4757-8284-4c4bc12427d9 for instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a on hv-cinder-83028 Jun 15 10:14:17.496975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-5ae9173a-3fa8-49b8-8743-80c2aef72238 req-6bd661c5-0e5e-44b6-a856-42fba8adb756 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158082 Jun 15 10:14:17.498298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 74/139] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:17.653624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ec31a832-3ee3-4748-a7da-a6f69a6cb413 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:17.663006 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ec31a832-3ee3-4748-a7da-a6f69a6cb413 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.227176 Jun 15 10:14:17.663600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 66/140] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:17 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:18.359261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:18.360818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:18.363849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5996b223-bd6b-47b8-a1af-67a61f6cc327 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:18.364629 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5996b223-bd6b-47b8-a1af-67a61f6cc327 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:18.367486 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:18.367972 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:18.369409 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:18.370647 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:18.372161 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5996b223-bd6b-47b8-a1af-67a61f6cc327 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:18.372624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5996b223-bd6b-47b8-a1af-67a61f6cc327 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:18.373475 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5996b223-bd6b-47b8-a1af-67a61f6cc327 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:18.374028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5996b223-bd6b-47b8-a1af-67a61f6cc327 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:18.610625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:18.620873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:18.622580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:18.623822 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5dfa7e2f-6fdc-4636-8831-da51b7379556 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.268854 Jun 15 10:14:18.626906 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 75/141] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:18 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:18.635608 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5996b223-bd6b-47b8-a1af-67a61f6cc327 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:18.645489 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5996b223-bd6b-47b8-a1af-67a61f6cc327 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.285328 Jun 15 10:14:18.646732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 67/142] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:18 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:18.681076 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e96696f6-2cab-49b3-9475-e5c1a3d7727c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:18.682082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e96696f6-2cab-49b3-9475-e5c1a3d7727c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:18.689082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e96696f6-2cab-49b3-9475-e5c1a3d7727c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:18.690201 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e96696f6-2cab-49b3-9475-e5c1a3d7727c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:18.691199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e96696f6-2cab-49b3-9475-e5c1a3d7727c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:18.691661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e96696f6-2cab-49b3-9475-e5c1a3d7727c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:18.871738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e96696f6-2cab-49b3-9475-e5c1a3d7727c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:18.879444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e96696f6-2cab-49b3-9475-e5c1a3d7727c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.202158 Jun 15 10:14:18.880855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 76/143] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:18 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:19.643633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:19.644238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:19.651569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:19.652186 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:19.653122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:19.653700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:19.663059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f780b7f0-7406-42c8-bf4e-8c3ca8e09fcd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:19.663674 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f780b7f0-7406-42c8-bf4e-8c3ca8e09fcd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:19.671726 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f780b7f0-7406-42c8-bf4e-8c3ca8e09fcd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:19.672171 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f780b7f0-7406-42c8-bf4e-8c3ca8e09fcd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:19.672952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f780b7f0-7406-42c8-bf4e-8c3ca8e09fcd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:19.673845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f780b7f0-7406-42c8-bf4e-8c3ca8e09fcd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:19.897554 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:19.902540 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f780b7f0-7406-42c8-bf4e-8c3ca8e09fcd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:19.909535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:19.910214 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f780b7f0-7406-42c8-bf4e-8c3ca8e09fcd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.250936 Jun 15 10:14:19.910812 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 77/144] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:19 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:19.912531 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:19.914245 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-23bd9cdd-18bd-42ef-81b0-1487c6c9ad6e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.274435 Jun 15 10:14:19.914994 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 68/145] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:19 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:19.927480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2779a166-41c1-4183-8dfb-eaf3a73d8bc8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:19.928100 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2779a166-41c1-4183-8dfb-eaf3a73d8bc8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:19.936040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2779a166-41c1-4183-8dfb-eaf3a73d8bc8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:19.937066 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2779a166-41c1-4183-8dfb-eaf3a73d8bc8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:19.938363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2779a166-41c1-4183-8dfb-eaf3a73d8bc8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:19.939443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2779a166-41c1-4183-8dfb-eaf3a73d8bc8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:19.965956 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:20.120816 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2779a166-41c1-4183-8dfb-eaf3a73d8bc8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:20.129581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2779a166-41c1-4183-8dfb-eaf3a73d8bc8 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.217370 Jun 15 10:14:20.131115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 78/146] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:19 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:20.929290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ea743354-8b96-4eed-91a1-3eb73489073e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:20.929909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ea743354-8b96-4eed-91a1-3eb73489073e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:20.931662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:20.933104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:20.950656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea743354-8b96-4eed-91a1-3eb73489073e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:20.951111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea743354-8b96-4eed-91a1-3eb73489073e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:20.951972 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea743354-8b96-4eed-91a1-3eb73489073e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:20.952553 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea743354-8b96-4eed-91a1-3eb73489073e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:20.953191 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:20.953945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:20.955017 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:20.955641 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:21.257249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:21.267146 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:21.268644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:21.269950 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f4314ad9-a98d-42eb-ad0c-9ff26f4139c2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.342213 Jun 15 10:14:21.270609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 79/147] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:20 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:21.274494 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ea743354-8b96-4eed-91a1-3eb73489073e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:21.276199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-13baa24c-df35-4935-a5d1-a36ca27eec70 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:21.277340 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-13baa24c-df35-4935-a5d1-a36ca27eec70 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:21.282989 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:21.285491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-13baa24c-df35-4935-a5d1-a36ca27eec70 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:21.286062 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-13baa24c-df35-4935-a5d1-a36ca27eec70 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:21.287109 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-13baa24c-df35-4935-a5d1-a36ca27eec70 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:21.287823 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-13baa24c-df35-4935-a5d1-a36ca27eec70 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:21.291076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ea743354-8b96-4eed-91a1-3eb73489073e tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.367269 Jun 15 10:14:21.292279 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 69/148] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:20 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:21.460724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-13baa24c-df35-4935-a5d1-a36ca27eec70 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:21.469269 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-13baa24c-df35-4935-a5d1-a36ca27eec70 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.196999 Jun 15 10:14:21.469870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 80/149] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:21 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:22.288975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:22.289617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:22.297289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:22.297774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:22.298632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:22.299099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:22.308779 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fa0eefb2-0679-4439-ad55-be9203040f20 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:22.309600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fa0eefb2-0679-4439-ad55-be9203040f20 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:22.316717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fa0eefb2-0679-4439-ad55-be9203040f20 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:22.317197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fa0eefb2-0679-4439-ad55-be9203040f20 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:22.318012 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fa0eefb2-0679-4439-ad55-be9203040f20 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:22.318491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fa0eefb2-0679-4439-ad55-be9203040f20 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:22.515823 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:22.517390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fa0eefb2-0679-4439-ad55-be9203040f20 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:22.525882 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:22.527689 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:22.527812 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fa0eefb2-0679-4439-ad55-be9203040f20 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.222986 Jun 15 10:14:22.528927 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 81/150] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:22 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:22.533998 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6d0c4109-e7fe-4e3c-93d9-770f70d6d4aa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:22.534695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6d0c4109-e7fe-4e3c-93d9-770f70d6d4aa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:22.539358 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d53e87a1-d526-4698-a34f-1f3eb9b3b946 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.244166 Jun 15 10:14:22.540344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 70/151] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:22 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:22.542725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d0c4109-e7fe-4e3c-93d9-770f70d6d4aa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:22.543445 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d0c4109-e7fe-4e3c-93d9-770f70d6d4aa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:22.547045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d0c4109-e7fe-4e3c-93d9-770f70d6d4aa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:22.547712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d0c4109-e7fe-4e3c-93d9-770f70d6d4aa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:22.698144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d0c4109-e7fe-4e3c-93d9-770f70d6d4aa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:22.706146 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6d0c4109-e7fe-4e3c-93d9-770f70d6d4aa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.176058 Jun 15 10:14:22.706747 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 82/152] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:22 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:23.545806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d12a002e-f7a5-4174-bc2c-cc648af41aa9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:23.546450 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d12a002e-f7a5-4174-bc2c-cc648af41aa9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:23.548308 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=72 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:23.557899 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:23.558665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:23.562227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d12a002e-f7a5-4174-bc2c-cc648af41aa9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:23.562702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d12a002e-f7a5-4174-bc2c-cc648af41aa9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:23.563475 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d12a002e-f7a5-4174-bc2c-cc648af41aa9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:23.564082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d12a002e-f7a5-4174-bc2c-cc648af41aa9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:23.567174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:23.567622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:23.568385 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:23.568813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:23.762026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d12a002e-f7a5-4174-bc2c-cc648af41aa9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:23.764078 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:23.769813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d12a002e-f7a5-4174-bc2c-cc648af41aa9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.228022 Jun 15 10:14:23.770732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 71/153] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:23 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:23.772189 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:23.773675 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:23.774795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-95d14e69-7108-46b9-9ad9-2147c2ef6072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.220711 Jun 15 10:14:23.775094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ff50b7cc-d434-4393-b051-d3f6b0b1b29a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:23.776429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 83/154] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:23 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:23.776563 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ff50b7cc-d434-4393-b051-d3f6b0b1b29a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:23.782551 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff50b7cc-d434-4393-b051-d3f6b0b1b29a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:23.783018 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff50b7cc-d434-4393-b051-d3f6b0b1b29a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:23.783764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff50b7cc-d434-4393-b051-d3f6b0b1b29a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:23.784198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff50b7cc-d434-4393-b051-d3f6b0b1b29a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:23.918089 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ff50b7cc-d434-4393-b051-d3f6b0b1b29a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:23.925985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ff50b7cc-d434-4393-b051-d3f6b0b1b29a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.154323 Jun 15 10:14:23.926581 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 72/155] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:23 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:24.788156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e076abb3-b0a8-4c4e-80a3-6929700f0020 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:24.788680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e076abb3-b0a8-4c4e-80a3-6929700f0020 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:24.790604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=80 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:24.792641 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:24.793254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:24.796326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e076abb3-b0a8-4c4e-80a3-6929700f0020 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:24.796775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e076abb3-b0a8-4c4e-80a3-6929700f0020 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:24.797554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e076abb3-b0a8-4c4e-80a3-6929700f0020 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:24.797992 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e076abb3-b0a8-4c4e-80a3-6929700f0020 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:24.799146 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:24.799595 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:24.800353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:24.800788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:24.989737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e076abb3-b0a8-4c4e-80a3-6929700f0020 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:24.993566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:24.997660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e076abb3-b0a8-4c4e-80a3-6929700f0020 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.213672 Jun 15 10:14:24.998222 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 84/156] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:24 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:25.002472 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:25.002617 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3b6d072f-7a42-4476-9cbd-544711ea50fa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:25.003173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3b6d072f-7a42-4476-9cbd-544711ea50fa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:25.004151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:25.005356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-102d2a83-9546-43c4-b382-105f512b6f5d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.216530 Jun 15 10:14:25.005987 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 73/157] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:24 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:25.008886 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3b6d072f-7a42-4476-9cbd-544711ea50fa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:25.009334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3b6d072f-7a42-4476-9cbd-544711ea50fa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:25.010700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3b6d072f-7a42-4476-9cbd-544711ea50fa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:25.011140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3b6d072f-7a42-4476-9cbd-544711ea50fa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:25.139714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3b6d072f-7a42-4476-9cbd-544711ea50fa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:25.147149 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3b6d072f-7a42-4476-9cbd-544711ea50fa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.147971 Jun 15 10:14:25.147704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 85/158] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:24 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:26.014522 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5a524581-17a1-4cf3-8e4e-a61a04db93fd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:26.015131 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5a524581-17a1-4cf3-8e4e-a61a04db93fd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:26.021188 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5a524581-17a1-4cf3-8e4e-a61a04db93fd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:26.021636 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5a524581-17a1-4cf3-8e4e-a61a04db93fd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:26.022436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5a524581-17a1-4cf3-8e4e-a61a04db93fd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:26.022896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5a524581-17a1-4cf3-8e4e-a61a04db93fd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:26.023411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:26.024024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:26.030809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:26.031258 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:26.032021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:26.032455 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:26.216886 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5a524581-17a1-4cf3-8e4e-a61a04db93fd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:26.223883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:26.224863 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5a524581-17a1-4cf3-8e4e-a61a04db93fd tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.214112 Jun 15 10:14:26.225434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 74/159] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:26 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:26.230286 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9c50b80c-0c11-4c6b-8713-4c3eb5d2ba84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:26.230907 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9c50b80c-0c11-4c6b-8713-4c3eb5d2ba84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:26.233920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:26.235721 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:26.236932 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3e110c83-a06e-4eff-a080-db62303d6a7a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.217279 Jun 15 10:14:26.237166 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c50b80c-0c11-4c6b-8713-4c3eb5d2ba84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:26.237609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 86/160] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:26 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:26.237711 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c50b80c-0c11-4c6b-8713-4c3eb5d2ba84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:26.238874 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c50b80c-0c11-4c6b-8713-4c3eb5d2ba84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:26.239324 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c50b80c-0c11-4c6b-8713-4c3eb5d2ba84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:26.367926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9c50b80c-0c11-4c6b-8713-4c3eb5d2ba84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:26.375268 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9c50b80c-0c11-4c6b-8713-4c3eb5d2ba84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.148743 Jun 15 10:14:26.375831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 75/161] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:26 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:27.244898 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a8e986df-ca55-4e6b-8068-ed60a790711c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:27.245513 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a8e986df-ca55-4e6b-8068-ed60a790711c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:27.253397 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8e986df-ca55-4e6b-8068-ed60a790711c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:27.253848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8e986df-ca55-4e6b-8068-ed60a790711c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:27.254505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:27.254999 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8e986df-ca55-4e6b-8068-ed60a790711c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:27.255079 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8e986df-ca55-4e6b-8068-ed60a790711c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:27.255171 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:27.261330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:27.261768 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:27.262554 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:27.262985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:27.449784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a8e986df-ca55-4e6b-8068-ed60a790711c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:27.453432 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:27.459034 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a8e986df-ca55-4e6b-8068-ed60a790711c tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.221507 Jun 15 10:14:27.459692 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 87/162] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:27 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:27.461736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:27.463920 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:27.464979 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7d48404a-c072-486d-afaa-3ef2234c1d1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:27.465655 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7d48404a-c072-486d-afaa-3ef2234c1d1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:27.466037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-10475045-d0c0-45ba-8cef-14316f845d54 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.214887 Jun 15 10:14:27.467043 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 76/163] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:27 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:27.480064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d48404a-c072-486d-afaa-3ef2234c1d1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:27.480518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d48404a-c072-486d-afaa-3ef2234c1d1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:27.481296 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d48404a-c072-486d-afaa-3ef2234c1d1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:27.481728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d48404a-c072-486d-afaa-3ef2234c1d1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:27.614540 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7d48404a-c072-486d-afaa-3ef2234c1d1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:27.622029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7d48404a-c072-486d-afaa-3ef2234c1d1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.161138 Jun 15 10:14:27.622575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 88/164] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:27 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:28.478230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6ecba3b7-931c-4ac9-ad9b-bdbc2a94bf18 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:28.479483 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6ecba3b7-931c-4ac9-ad9b-bdbc2a94bf18 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:28.483858 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:28.485261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:28.486657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ecba3b7-931c-4ac9-ad9b-bdbc2a94bf18 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:28.487101 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ecba3b7-931c-4ac9-ad9b-bdbc2a94bf18 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:28.488026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ecba3b7-931c-4ac9-ad9b-bdbc2a94bf18 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:28.488285 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ecba3b7-931c-4ac9-ad9b-bdbc2a94bf18 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:28.492823 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:28.493241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:28.494789 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:28.495230 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:28.691304 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ecba3b7-931c-4ac9-ad9b-bdbc2a94bf18 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:28.695122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:28.699572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6ecba3b7-931c-4ac9-ad9b-bdbc2a94bf18 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.226262 Jun 15 10:14:28.700229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 77/165] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:28 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:28.704991 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-68d78945-98c4-4bf3-8f70-8a0ab4c04ebf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:28.705617 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:28.706171 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-68d78945-98c4-4bf3-8f70-8a0ab4c04ebf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:28.707287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:28.708387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a31d88e8-1689-4141-8def-6187a6ab31b4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.228510 Jun 15 10:14:28.708926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 89/166] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:28 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:28.713597 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-68d78945-98c4-4bf3-8f70-8a0ab4c04ebf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:28.714047 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-68d78945-98c4-4bf3-8f70-8a0ab4c04ebf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:28.714847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-68d78945-98c4-4bf3-8f70-8a0ab4c04ebf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:28.715283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-68d78945-98c4-4bf3-8f70-8a0ab4c04ebf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:28.763982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-a8a73166-dc5b-4883-a264-bba4365265b7 req-ac8d3fcb-b333-420a-8be8-2a0206cfe48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea751c2f-c929-4939-b72c-70a5487bba0a", "name": "network-vif-plugged", "status": "completed", "tag": "f8d02131-5cb5-405d-8ed7-13f30cd0921e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:28.776288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a8a73166-dc5b-4883-a264-bba4365265b7 req-ac8d3fcb-b333-420a-8be8-2a0206cfe48a service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:28.776841 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a8a73166-dc5b-4883-a264-bba4365265b7 req-ac8d3fcb-b333-420a-8be8-2a0206cfe48a service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:28.789423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-a8a73166-dc5b-4883-a264-bba4365265b7 req-ac8d3fcb-b333-420a-8be8-2a0206cfe48a service nova] Creating event network-vif-plugged:f8d02131-5cb5-405d-8ed7-13f30cd0921e for instance ea751c2f-c929-4939-b72c-70a5487bba0a on hv-cinder-83028 Jun 15 10:14:28.795936 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-a8a73166-dc5b-4883-a264-bba4365265b7 req-ac8d3fcb-b333-420a-8be8-2a0206cfe48a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036183 Jun 15 10:14:28.796889 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 90/167] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:14:28.849867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-68d78945-98c4-4bf3-8f70-8a0ab4c04ebf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:28.859956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-68d78945-98c4-4bf3-8f70-8a0ab4c04ebf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.156830 Jun 15 10:14:28.860968 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 78/168] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:28 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:29.716075 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6446393d-092d-4ab2-b7c4-5c4b89b3cedc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:29.716777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6446393d-092d-4ab2-b7c4-5c4b89b3cedc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:29.723207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6446393d-092d-4ab2-b7c4-5c4b89b3cedc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:29.723658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6446393d-092d-4ab2-b7c4-5c4b89b3cedc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:29.724418 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6446393d-092d-4ab2-b7c4-5c4b89b3cedc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:29.724856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6446393d-092d-4ab2-b7c4-5c4b89b3cedc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:29.726626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:29.727250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:29.733684 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:29.734404 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:29.735167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:29.735614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:29.930989 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:29.933967 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6446393d-092d-4ab2-b7c4-5c4b89b3cedc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:29.942426 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6446393d-092d-4ab2-b7c4-5c4b89b3cedc tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.230599 Jun 15 10:14:29.945714 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:29.947577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:29.959571 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 91/169] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:29 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:29.960204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c84ff6c1-a641-4eb9-bb33-8119733fde09 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.226897 Jun 15 10:14:29.960836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 79/170] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:29 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:29.974958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-275a6aa1-bcde-4bcd-a764-83f81a1d15ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:29.975556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-275a6aa1-bcde-4bcd-a764-83f81a1d15ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:29.982372 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-275a6aa1-bcde-4bcd-a764-83f81a1d15ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:29.982856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-275a6aa1-bcde-4bcd-a764-83f81a1d15ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:29.983582 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-275a6aa1-bcde-4bcd-a764-83f81a1d15ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:29.984016 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-275a6aa1-bcde-4bcd-a764-83f81a1d15ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:30.116680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-275a6aa1-bcde-4bcd-a764-83f81a1d15ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:30.126987 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-275a6aa1-bcde-4bcd-a764-83f81a1d15ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.165980 Jun 15 10:14:30.127974 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 92/171] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:29 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:30.964616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5b1a624d-ed14-4b21-a2f9-031f51dd15a2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:30.965593 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5b1a624d-ed14-4b21-a2f9-031f51dd15a2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:30.976572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:30.977329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:30.980790 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b1a624d-ed14-4b21-a2f9-031f51dd15a2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:30.981246 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b1a624d-ed14-4b21-a2f9-031f51dd15a2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:30.982035 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b1a624d-ed14-4b21-a2f9-031f51dd15a2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:30.982500 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b1a624d-ed14-4b21-a2f9-031f51dd15a2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:30.986185 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:30.986766 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:30.988687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:30.988687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:31.210311 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5b1a624d-ed14-4b21-a2f9-031f51dd15a2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:31.214930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:31.219108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5b1a624d-ed14-4b21-a2f9-031f51dd15a2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.258318 Jun 15 10:14:31.220017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 80/172] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:30 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:31.224622 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0504cef7-1db6-4fe4-8d0b-7e291a7097ca tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:31.225230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0504cef7-1db6-4fe4-8d0b-7e291a7097ca tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:31.232282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0504cef7-1db6-4fe4-8d0b-7e291a7097ca tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:31.232666 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:31.232858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0504cef7-1db6-4fe4-8d0b-7e291a7097ca tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:31.233753 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0504cef7-1db6-4fe4-8d0b-7e291a7097ca tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:31.234790 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0504cef7-1db6-4fe4-8d0b-7e291a7097ca tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:31.234982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:31.236378 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e30f4d7e-acf4-4a82-a3b8-418acc6de4e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.263317 Jun 15 10:14:31.236991 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 93/173] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:30 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:31.404099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0504cef7-1db6-4fe4-8d0b-7e291a7097ca tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:31.411478 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0504cef7-1db6-4fe4-8d0b-7e291a7097ca tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.190394 Jun 15 10:14:31.412305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 81/174] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:31 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:32.236454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b731e22d-3ffa-4d9a-9f66-07ebc920e370 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:32.237071 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b731e22d-3ffa-4d9a-9f66-07ebc920e370 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:32.243353 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b731e22d-3ffa-4d9a-9f66-07ebc920e370 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:32.244450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b731e22d-3ffa-4d9a-9f66-07ebc920e370 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:32.245220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b731e22d-3ffa-4d9a-9f66-07ebc920e370 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:32.245819 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b731e22d-3ffa-4d9a-9f66-07ebc920e370 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:32.257809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:32.259979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:32.267597 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:32.268040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:32.268973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:32.269669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:32.440377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b731e22d-3ffa-4d9a-9f66-07ebc920e370 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:32.451201 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b731e22d-3ffa-4d9a-9f66-07ebc920e370 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.218621 Jun 15 10:14:32.452463 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 94/175] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:32 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:32.457277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8d2d8df3-173c-45f1-bdef-5b2ec825fcb2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:32.457965 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8d2d8df3-173c-45f1-bdef-5b2ec825fcb2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:32.464866 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d2d8df3-173c-45f1-bdef-5b2ec825fcb2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:32.465347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d2d8df3-173c-45f1-bdef-5b2ec825fcb2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:32.466402 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d2d8df3-173c-45f1-bdef-5b2ec825fcb2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:32.466842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d2d8df3-173c-45f1-bdef-5b2ec825fcb2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:32.476701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:32.482879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:32.488420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:32.490495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:32.491890 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-731905e3-f38b-410f-8e02-e0e06c429a3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.239159 Jun 15 10:14:32.492560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 82/176] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:32 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:32.603180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8d2d8df3-173c-45f1-bdef-5b2ec825fcb2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:32.612133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8d2d8df3-173c-45f1-bdef-5b2ec825fcb2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.158429 Jun 15 10:14:32.612723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 95/177] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:32 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:33.472909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-29870229-dd7c-4ab8-80f5-068dd940fd74 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:33.473622 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-29870229-dd7c-4ab8-80f5-068dd940fd74 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:33.480350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-29870229-dd7c-4ab8-80f5-068dd940fd74 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:33.480797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-29870229-dd7c-4ab8-80f5-068dd940fd74 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:33.481557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-29870229-dd7c-4ab8-80f5-068dd940fd74 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:33.481992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-29870229-dd7c-4ab8-80f5-068dd940fd74 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:33.511113 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:33.511838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:33.518636 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:33.519166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:33.520052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:33.520823 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:33.860429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-29870229-dd7c-4ab8-80f5-068dd940fd74 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:33.871081 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-29870229-dd7c-4ab8-80f5-068dd940fd74 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.401963 Jun 15 10:14:33.871732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 83/178] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:33 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:33.876742 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-92317c3d-5729-471c-bfcd-c7e7f09512ee tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:33.877962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-92317c3d-5729-471c-bfcd-c7e7f09512ee tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:33.883948 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92317c3d-5729-471c-bfcd-c7e7f09512ee tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:33.884910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92317c3d-5729-471c-bfcd-c7e7f09512ee tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:33.885068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:33.885725 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92317c3d-5729-471c-bfcd-c7e7f09512ee tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:33.886180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92317c3d-5729-471c-bfcd-c7e7f09512ee tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:33.896195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:33.897719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:33.899109 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c9840248-fc15-4e41-8b7d-af9574f7a24e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.391975 Jun 15 10:14:33.899680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 96/179] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:33 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:34.029378 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-92317c3d-5729-471c-bfcd-c7e7f09512ee tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:34.037056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-92317c3d-5729-471c-bfcd-c7e7f09512ee tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.164014 Jun 15 10:14:34.037625 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 84/180] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:33 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:34.887677 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e19272f3-8877-41ea-9c83-76bc89a1faf8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:34.888742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e19272f3-8877-41ea-9c83-76bc89a1faf8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:34.894993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e19272f3-8877-41ea-9c83-76bc89a1faf8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:34.895680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e19272f3-8877-41ea-9c83-76bc89a1faf8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:34.896457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e19272f3-8877-41ea-9c83-76bc89a1faf8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:34.897074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e19272f3-8877-41ea-9c83-76bc89a1faf8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:34.917398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:34.918668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:34.924524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:34.924969 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:34.925729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:34.926183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:35.086238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e19272f3-8877-41ea-9c83-76bc89a1faf8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:35.095676 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e19272f3-8877-41ea-9c83-76bc89a1faf8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.212079 Jun 15 10:14:35.096253 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 97/181] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:34 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:35.101049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fe57aa77-268e-45b2-a36b-5c0edd257524 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:35.101890 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fe57aa77-268e-45b2-a36b-5c0edd257524 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:35.108930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe57aa77-268e-45b2-a36b-5c0edd257524 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:35.109842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe57aa77-268e-45b2-a36b-5c0edd257524 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:35.110686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe57aa77-268e-45b2-a36b-5c0edd257524 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:35.111288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe57aa77-268e-45b2-a36b-5c0edd257524 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:35.131244 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:35.142502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:35.144341 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:35.146274 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bdfc703a-ea1f-42ae-9c87-d36283941343 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.233272 Jun 15 10:14:35.146865 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 85/182] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:34 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:35.262631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fe57aa77-268e-45b2-a36b-5c0edd257524 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:35.269551 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fe57aa77-268e-45b2-a36b-5c0edd257524 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.172027 Jun 15 10:14:35.271334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 98/183] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:35 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:36.113705 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-921d41dc-af2e-4fd7-9652-afb3a028f8a8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:36.114357 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-921d41dc-af2e-4fd7-9652-afb3a028f8a8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:36.121071 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-921d41dc-af2e-4fd7-9652-afb3a028f8a8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:36.121513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-921d41dc-af2e-4fd7-9652-afb3a028f8a8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:36.122263 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-921d41dc-af2e-4fd7-9652-afb3a028f8a8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:36.122720 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-921d41dc-af2e-4fd7-9652-afb3a028f8a8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:36.137201 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:36.164313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:36.165003 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:36.172400 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:36.172911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:36.173612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:36.174046 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:36.303696 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-921d41dc-af2e-4fd7-9652-afb3a028f8a8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:36.311384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-921d41dc-af2e-4fd7-9652-afb3a028f8a8 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.201520 Jun 15 10:14:36.312046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 86/184] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:36 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:36.316498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e69d740d-58a0-4661-aafc-175458cb2923 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:36.317200 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e69d740d-58a0-4661-aafc-175458cb2923 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:36.323022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e69d740d-58a0-4661-aafc-175458cb2923 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:36.323460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e69d740d-58a0-4661-aafc-175458cb2923 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:36.324211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e69d740d-58a0-4661-aafc-175458cb2923 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:36.324636 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e69d740d-58a0-4661-aafc-175458cb2923 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:36.337072 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:36.347749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:36.349877 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:36.351569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-62e84909-1695-4d85-9f62-7ed8cb43c169 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.190935 Jun 15 10:14:36.354446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 99/185] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:36 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:36.459928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e69d740d-58a0-4661-aafc-175458cb2923 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:36.469016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e69d740d-58a0-4661-aafc-175458cb2923 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.155908 Jun 15 10:14:36.469590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 87/186] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:36 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:37.331338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-72094def-fb9a-4413-a859-f6c3370d59ec tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:37.331338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-72094def-fb9a-4413-a859-f6c3370d59ec tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:37.335504 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72094def-fb9a-4413-a859-f6c3370d59ec tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:37.335953 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72094def-fb9a-4413-a859-f6c3370d59ec tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:37.337984 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72094def-fb9a-4413-a859-f6c3370d59ec tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:37.337984 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72094def-fb9a-4413-a859-f6c3370d59ec tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:37.371216 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:37.371807 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:37.377954 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:37.378847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:37.379201 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:37.379639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:37.520458 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-72094def-fb9a-4413-a859-f6c3370d59ec tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:37.527892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-72094def-fb9a-4413-a859-f6c3370d59ec tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.202899 Jun 15 10:14:37.528556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 100/187] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:37 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:37.533138 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d5a16f1c-87c6-46fb-a721-76ac205c45a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:37.533817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d5a16f1c-87c6-46fb-a721-76ac205c45a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:37.541627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5a16f1c-87c6-46fb-a721-76ac205c45a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:37.542254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5a16f1c-87c6-46fb-a721-76ac205c45a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:37.543758 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5a16f1c-87c6-46fb-a721-76ac205c45a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:37.543758 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5a16f1c-87c6-46fb-a721-76ac205c45a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:37.560232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:37.569638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:37.571163 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:37.572867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7699b193-7ce8-43f7-83e0-4ac32dc3c346 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.206103 Jun 15 10:14:37.573432 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 88/188] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:37 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:37.687088 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d5a16f1c-87c6-46fb-a721-76ac205c45a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:37.696902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d5a16f1c-87c6-46fb-a721-76ac205c45a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.166930 Jun 15 10:14:37.697847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 101/189] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:37 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:38.545557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6299de84-d4f4-4190-9391-483c41140fc4 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:38.546165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6299de84-d4f4-4190-9391-483c41140fc4 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:38.552119 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6299de84-d4f4-4190-9391-483c41140fc4 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:38.552566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6299de84-d4f4-4190-9391-483c41140fc4 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:38.553316 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6299de84-d4f4-4190-9391-483c41140fc4 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:38.553901 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6299de84-d4f4-4190-9391-483c41140fc4 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:38.590399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:38.591124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:38.597123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:38.597571 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:38.598403 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:38.598845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:38.744245 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6299de84-d4f4-4190-9391-483c41140fc4 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:38.751520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6299de84-d4f4-4190-9391-483c41140fc4 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.209746 Jun 15 10:14:38.752088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 89/190] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:38 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:38.756812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f4de3c7a-b73e-4d0b-88bf-179d6b1c3893 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:38.757481 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f4de3c7a-b73e-4d0b-88bf-179d6b1c3893 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:38.764383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4de3c7a-b73e-4d0b-88bf-179d6b1c3893 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:38.764911 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4de3c7a-b73e-4d0b-88bf-179d6b1c3893 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:38.765798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4de3c7a-b73e-4d0b-88bf-179d6b1c3893 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:38.766328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4de3c7a-b73e-4d0b-88bf-179d6b1c3893 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:38.771560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:38.779501 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:38.781024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:38.782135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8c3d5344-4546-4e28-9285-b8707d122857 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.195789 Jun 15 10:14:38.782723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 102/191] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:38 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:38.891759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f4de3c7a-b73e-4d0b-88bf-179d6b1c3893 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:38.899294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f4de3c7a-b73e-4d0b-88bf-179d6b1c3893 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.146272 Jun 15 10:14:38.899893 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 90/192] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:38 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:39.768617 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-72421b13-9e06-4bd7-938c-198ac4f71d92 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:39.769122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-72421b13-9e06-4bd7-938c-198ac4f71d92 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:39.776347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72421b13-9e06-4bd7-938c-198ac4f71d92 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:39.776791 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72421b13-9e06-4bd7-938c-198ac4f71d92 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:39.777547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72421b13-9e06-4bd7-938c-198ac4f71d92 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:39.777982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72421b13-9e06-4bd7-938c-198ac4f71d92 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:39.800353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:39.800963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:39.806860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:39.807314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:39.808097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:39.808523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:39.970182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-72421b13-9e06-4bd7-938c-198ac4f71d92 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:39.977912 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-72421b13-9e06-4bd7-938c-198ac4f71d92 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.213227 Jun 15 10:14:39.978728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 103/193] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:39 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:39.983425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8731c688-53ae-45ea-9ac4-ed038bc7de34 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:39.984290 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8731c688-53ae-45ea-9ac4-ed038bc7de34 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:39.990456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8731c688-53ae-45ea-9ac4-ed038bc7de34 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:39.990916 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8731c688-53ae-45ea-9ac4-ed038bc7de34 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:39.991691 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8731c688-53ae-45ea-9ac4-ed038bc7de34 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:39.992136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8731c688-53ae-45ea-9ac4-ed038bc7de34 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:39.996733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:40.010587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:40.012086 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:40.013192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd0846b9-8b28-46f2-ac63-f4012fa24ad5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.216700 Jun 15 10:14:40.013746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 91/194] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:39 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:40.123134 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8731c688-53ae-45ea-9ac4-ed038bc7de34 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:40.130443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8731c688-53ae-45ea-9ac4-ed038bc7de34 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.150481 Jun 15 10:14:40.131012 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 104/195] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:39 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:40.995212 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5693e657-72a0-4e63-bda3-08479aa26863 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:40.995828 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5693e657-72a0-4e63-bda3-08479aa26863 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:41.001845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5693e657-72a0-4e63-bda3-08479aa26863 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:41.002320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5693e657-72a0-4e63-bda3-08479aa26863 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:41.003155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5693e657-72a0-4e63-bda3-08479aa26863 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:41.003599 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5693e657-72a0-4e63-bda3-08479aa26863 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:41.031246 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:41.031855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:41.038549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:41.039004 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:41.039768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:41.041532 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:41.188182 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5693e657-72a0-4e63-bda3-08479aa26863 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:41.195642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5693e657-72a0-4e63-bda3-08479aa26863 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1314 microversion: 2.1 time: 0.204390 Jun 15 10:14:41.205484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 92/196] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:40 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:41.205484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-58f86ae4-d36b-46f5-b8cf-42e6c6191349 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:41.205484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-58f86ae4-d36b-46f5-b8cf-42e6c6191349 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:41.209955 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-58f86ae4-d36b-46f5-b8cf-42e6c6191349 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:41.210507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-58f86ae4-d36b-46f5-b8cf-42e6c6191349 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:41.211398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-58f86ae4-d36b-46f5-b8cf-42e6c6191349 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:41.211945 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-58f86ae4-d36b-46f5-b8cf-42e6c6191349 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:41.216144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:41.224081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:41.225598 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:41.226739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c51a6896-6016-401b-9bf4-38b19dad40d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.199301 Jun 15 10:14:41.227436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 105/197] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:41 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:41.350614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-58f86ae4-d36b-46f5-b8cf-42e6c6191349 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:41.359686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-58f86ae4-d36b-46f5-b8cf-42e6c6191349 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.161563 Jun 15 10:14:41.360266 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 93/198] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:41 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:41.502433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-4dda690e-d9e5-466f-8f32-4627dc5443f5 req-076c0f3b-ecfd-44c7-9eb7-e5aee1be40fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf", "name": "network-vif-plugged", "status": "completed", "tag": "46ca2b51-7c1c-444b-8134-9d5e61874f98"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:41.524257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-4dda690e-d9e5-466f-8f32-4627dc5443f5 req-076c0f3b-ecfd-44c7-9eb7-e5aee1be40fb service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:41.525261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-4dda690e-d9e5-466f-8f32-4627dc5443f5 req-076c0f3b-ecfd-44c7-9eb7-e5aee1be40fb service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:41.541486 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-4dda690e-d9e5-466f-8f32-4627dc5443f5 req-076c0f3b-ecfd-44c7-9eb7-e5aee1be40fb service nova] Creating event network-vif-plugged:46ca2b51-7c1c-444b-8134-9d5e61874f98 for instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf on hv-cinder-83028 Jun 15 10:14:41.547171 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-4dda690e-d9e5-466f-8f32-4627dc5443f5 req-076c0f3b-ecfd-44c7-9eb7-e5aee1be40fb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049127 Jun 15 10:14:41.547617 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 106/199] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:42.213762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-167abd42-2664-4711-b4f0-d3de28c7c9f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:42.214475 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-167abd42-2664-4711-b4f0-d3de28c7c9f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:42.220501 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-167abd42-2664-4711-b4f0-d3de28c7c9f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:42.220944 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-167abd42-2664-4711-b4f0-d3de28c7c9f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:42.221701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-167abd42-2664-4711-b4f0-d3de28c7c9f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:42.222130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-167abd42-2664-4711-b4f0-d3de28c7c9f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:42.245489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:42.246406 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:42.252564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:42.253021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:42.253789 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:42.254230 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:42.403829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-167abd42-2664-4711-b4f0-d3de28c7c9f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:42.412278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-167abd42-2664-4711-b4f0-d3de28c7c9f9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1500 microversion: 2.1 time: 0.203074 Jun 15 10:14:42.412860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 94/200] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:42 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1500 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:42.419523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4a0265f7-bdec-4108-8008-fa2c71bf49bf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:42.420136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4a0265f7-bdec-4108-8008-fa2c71bf49bf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:42.426473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a0265f7-bdec-4108-8008-fa2c71bf49bf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:42.427723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a0265f7-bdec-4108-8008-fa2c71bf49bf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:42.428915 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a0265f7-bdec-4108-8008-fa2c71bf49bf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:42.429560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a0265f7-bdec-4108-8008-fa2c71bf49bf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:42.452682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:42.464494 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:42.466252 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:42.467406 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f4d8dc4b-a4f9-4fa9-82cf-0265b9e1c5c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.226224 Jun 15 10:14:42.470164 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 107/201] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:42 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:42.596150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4a0265f7-bdec-4108-8008-fa2c71bf49bf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:42.616745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4a0265f7-bdec-4108-8008-fa2c71bf49bf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.192383 Jun 15 10:14:42.617619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 95/202] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:42 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:43.485992 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:43.486622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:43.492418 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:43.492863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:43.494025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:43.494856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:43.620733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:43.628272 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:43.629780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:43.630917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-238e8cd9-e1d9-4f1b-acc0-1c931e79d35b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.149010 Jun 15 10:14:43.631625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 108/203] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:43 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:43.633187 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cbadab21-95c2-4afa-bb7c-ac4581a368e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:43.634401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cbadab21-95c2-4afa-bb7c-ac4581a368e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:43.640736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cbadab21-95c2-4afa-bb7c-ac4581a368e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:43.641245 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cbadab21-95c2-4afa-bb7c-ac4581a368e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:43.642170 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cbadab21-95c2-4afa-bb7c-ac4581a368e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:43.642754 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cbadab21-95c2-4afa-bb7c-ac4581a368e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:43.774052 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cbadab21-95c2-4afa-bb7c-ac4581a368e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:43.782065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cbadab21-95c2-4afa-bb7c-ac4581a368e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.153008 Jun 15 10:14:43.782657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 96/204] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:43 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:44.648753 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:44.649903 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:44.656043 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:44.656493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:44.657252 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:44.657690 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:44.786143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:44.795771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:44.797303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:44.798435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a635b022-82e3-4077-abc4-c68536512768 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.153541 Jun 15 10:14:44.798790 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7edb5bc0-900f-44a0-89fc-acc8c6c9013f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:44.799235 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 109/205] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:44 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:44.799412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7edb5bc0-900f-44a0-89fc-acc8c6c9013f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:44.805377 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7edb5bc0-900f-44a0-89fc-acc8c6c9013f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:44.805998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7edb5bc0-900f-44a0-89fc-acc8c6c9013f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:44.806799 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7edb5bc0-900f-44a0-89fc-acc8c6c9013f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:44.807241 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7edb5bc0-900f-44a0-89fc-acc8c6c9013f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:44.943153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7edb5bc0-900f-44a0-89fc-acc8c6c9013f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:44.951212 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7edb5bc0-900f-44a0-89fc-acc8c6c9013f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.156244 Jun 15 10:14:44.951779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 97/206] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:44 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:45.816379 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:45.816993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:45.823629 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:45.824081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:45.824850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:45.825287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:45.958459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:45.966297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:45.967785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:45.967909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9b00297f-9eae-4132-9d35-114b8db0d8df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:45.968445 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9b00297f-9eae-4132-9d35-114b8db0d8df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:45.968874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c3578768-64c5-431e-b718-ad577e0dd6a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.156291 Jun 15 10:14:45.969425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 110/207] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:45 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:45.974340 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b00297f-9eae-4132-9d35-114b8db0d8df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:45.974791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b00297f-9eae-4132-9d35-114b8db0d8df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:45.975553 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b00297f-9eae-4132-9d35-114b8db0d8df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:45.975976 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b00297f-9eae-4132-9d35-114b8db0d8df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:46.104414 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9b00297f-9eae-4132-9d35-114b8db0d8df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:46.113473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9b00297f-9eae-4132-9d35-114b8db0d8df tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.149336 Jun 15 10:14:46.119379 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 98/208] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:45 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:46.986854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:46.987462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:46.993297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:46.993737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:46.994516 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:46.994944 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:47.130933 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a53083ee-88a6-46a1-af31-f8eaf3b07b2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:47.131627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a53083ee-88a6-46a1-af31-f8eaf3b07b2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:47.135765 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:47.140040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a53083ee-88a6-46a1-af31-f8eaf3b07b2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:47.140566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a53083ee-88a6-46a1-af31-f8eaf3b07b2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:47.141491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a53083ee-88a6-46a1-af31-f8eaf3b07b2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:47.142024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a53083ee-88a6-46a1-af31-f8eaf3b07b2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:47.143626 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:47.145142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:47.146244 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-df598beb-fdea-4506-ad0f-6c2111006c24 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.163498 Jun 15 10:14:47.147345 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 111/209] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:46 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:47.283007 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a53083ee-88a6-46a1-af31-f8eaf3b07b2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:47.291367 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a53083ee-88a6-46a1-af31-f8eaf3b07b2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.164332 Jun 15 10:14:47.291949 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 99/210] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:47 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:48.166054 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:48.166718 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:48.172837 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:48.173281 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:48.174034 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:48.174512 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:48.308530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7686de98-8bdf-4b00-8c3d-b685452fb395 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:48.310417 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7686de98-8bdf-4b00-8c3d-b685452fb395 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:48.317802 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7686de98-8bdf-4b00-8c3d-b685452fb395 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:48.318463 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7686de98-8bdf-4b00-8c3d-b685452fb395 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:48.319512 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7686de98-8bdf-4b00-8c3d-b685452fb395 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:48.319949 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7686de98-8bdf-4b00-8c3d-b685452fb395 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:48.418740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:48.421002 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:48.428236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:48.429937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:48.432522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b60f8e77-e7c3-4bed-a560-b3dfd9dff47e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.271266 Jun 15 10:14:48.433187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 112/211] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:48 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:48.496046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7686de98-8bdf-4b00-8c3d-b685452fb395 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:48.503388 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7686de98-8bdf-4b00-8c3d-b685452fb395 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.199765 Jun 15 10:14:48.503963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 100/212] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:48 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:49.126666 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8aa3c76b-4edd-45f3-9835-a45175fb98c6 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "712b5499-ed88-40e1-941b-cf63692af9b9"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:49.128096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8aa3c76b-4edd-45f3-9835-a45175fb98c6 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:49.135505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8aa3c76b-4edd-45f3-9835-a45175fb98c6 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:49.136213 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8aa3c76b-4edd-45f3-9835-a45175fb98c6 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:49.137584 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8aa3c76b-4edd-45f3-9835-a45175fb98c6 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:49.139013 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8aa3c76b-4edd-45f3-9835-a45175fb98c6 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:49.451691 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:49.453169 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:49.459856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:49.460383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:49.461258 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:49.462342 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:49.611907 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:49.620811 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:49.622469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:49.624234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-65e720b3-381b-47eb-822e-1795fbceffa1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.176759 Jun 15 10:14:49.635851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 101/213] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:49 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:49.641564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-50563e3d-a574-458d-8af1-825f0ec18caf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:49.642306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-50563e3d-a574-458d-8af1-825f0ec18caf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:49.649934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-50563e3d-a574-458d-8af1-825f0ec18caf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:49.650565 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-50563e3d-a574-458d-8af1-825f0ec18caf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:49.651390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-50563e3d-a574-458d-8af1-825f0ec18caf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:49.651838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-50563e3d-a574-458d-8af1-825f0ec18caf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:49.811763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-50563e3d-a574-458d-8af1-825f0ec18caf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:49.833189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-50563e3d-a574-458d-8af1-825f0ec18caf tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.196136 Jun 15 10:14:49.835344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 102/214] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:49 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:50.641556 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:50.642209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:50.648104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:50.648544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:50.649821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:50.650250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:50.654164 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:50.798323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:50.807821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:50.809881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:50.811121 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-713f19f8-56fb-476a-b641-5114d154d8cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.173296 Jun 15 10:14:50.811741 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 103/215] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:50 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:50.851967 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ba1c93ce-75da-4962-bd6f-05fa30e1493f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:50.853740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ba1c93ce-75da-4962-bd6f-05fa30e1493f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:50.863814 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba1c93ce-75da-4962-bd6f-05fa30e1493f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:50.864264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba1c93ce-75da-4962-bd6f-05fa30e1493f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:50.865175 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba1c93ce-75da-4962-bd6f-05fa30e1493f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:50.865616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba1c93ce-75da-4962-bd6f-05fa30e1493f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:51.013640 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ba1c93ce-75da-4962-bd6f-05fa30e1493f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:51.021108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ba1c93ce-75da-4962-bd6f-05fa30e1493f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.173891 Jun 15 10:14:51.021703 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 104/216] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:50 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:51.829772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:51.830421 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:51.836996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:51.837586 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:51.838384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:51.838822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:51.966260 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:51.974085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:51.975623 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:51.976727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9ba533d8-b57f-4153-9dc1-1b7ef1ab00bd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.150809 Jun 15 10:14:51.977296 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 105/217] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:51 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:52.037865 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ef33790d-124c-4926-80ee-d405f04cd0f5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:52.038436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ef33790d-124c-4926-80ee-d405f04cd0f5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:52.044841 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef33790d-124c-4926-80ee-d405f04cd0f5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:52.045282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef33790d-124c-4926-80ee-d405f04cd0f5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:52.046059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef33790d-124c-4926-80ee-d405f04cd0f5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:52.046527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef33790d-124c-4926-80ee-d405f04cd0f5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:52.172971 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ef33790d-124c-4926-80ee-d405f04cd0f5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:52.181209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ef33790d-124c-4926-80ee-d405f04cd0f5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.147027 Jun 15 10:14:52.182008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 106/218] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:52 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:52.994000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:52.994634 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:53.000800 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:53.001249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:53.002017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:53.002491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:53.136242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:53.144083 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:53.145593 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:53.146725 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-854eba44-9976-4f14-a3ff-1cf109a2eaf6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.156578 Jun 15 10:14:53.147280 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 107/219] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:52 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:53.198014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1705dd0c-e7dd-4c38-87e7-b3dee01062ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:53.198740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1705dd0c-e7dd-4c38-87e7-b3dee01062ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:53.205533 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1705dd0c-e7dd-4c38-87e7-b3dee01062ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:53.206257 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1705dd0c-e7dd-4c38-87e7-b3dee01062ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:53.207167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1705dd0c-e7dd-4c38-87e7-b3dee01062ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:53.207602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1705dd0c-e7dd-4c38-87e7-b3dee01062ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:53.347876 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1705dd0c-e7dd-4c38-87e7-b3dee01062ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:53.356348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1705dd0c-e7dd-4c38-87e7-b3dee01062ab tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.162352 Jun 15 10:14:53.356924 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 108/220] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:53 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:54.164521 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:54.165178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:54.166992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=76 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:54.172460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:54.172915 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:54.173675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:54.174112 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:54.487367 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:54.496996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:54.498675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:54.499842 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2c35a314-e4ac-493a-8d1a-4d9f5856fbd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.339298 Jun 15 10:14:54.500390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 109/221] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:54 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:54.504886 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7bbf689b-7387-45d6-8aa8-93292d796119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:54.505651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7bbf689b-7387-45d6-8aa8-93292d796119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:54.512807 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7bbf689b-7387-45d6-8aa8-93292d796119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:54.513258 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7bbf689b-7387-45d6-8aa8-93292d796119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:54.514021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7bbf689b-7387-45d6-8aa8-93292d796119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:54.514485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7bbf689b-7387-45d6-8aa8-93292d796119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:54.659598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7bbf689b-7387-45d6-8aa8-93292d796119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:54.673215 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7bbf689b-7387-45d6-8aa8-93292d796119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.171808 Jun 15 10:14:54.673805 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 110/222] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:54 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:55.517722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:55.518421 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:55.524269 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:55.525157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:55.525914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:55.526371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:55.659030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:55.667422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:55.668919 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:55.670047 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-87f21da3-2adb-4702-8e55-6bf7d68db7bb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.156164 Jun 15 10:14:55.670647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 111/223] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:55 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:55.689500 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-101b694a-253e-4e03-8fb6-18cea8402d24 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:55.690096 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-101b694a-253e-4e03-8fb6-18cea8402d24 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:55.695951 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-101b694a-253e-4e03-8fb6-18cea8402d24 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:55.696447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-101b694a-253e-4e03-8fb6-18cea8402d24 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:55.697197 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-101b694a-253e-4e03-8fb6-18cea8402d24 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:55.697632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-101b694a-253e-4e03-8fb6-18cea8402d24 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:55.826447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-101b694a-253e-4e03-8fb6-18cea8402d24 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:55.834954 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-101b694a-253e-4e03-8fb6-18cea8402d24 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.149173 Jun 15 10:14:55.835524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 112/224] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:55 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:56.690564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:56.691221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:56.701467 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:56.702079 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:56.703258 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:56.703707 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:56.785219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8aa3c76b-4edd-45f3-9835-a45175fb98c6 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "POST /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.662697 Jun 15 10:14:56.786375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 113/225] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:14:49 2022] POST /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a/os-volume_attachments => generated 194 bytes in 7664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:56.850652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:56.852004 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8b6bb468-87cd-4f35-9a37-ffe535d2d7e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:56.854042 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8b6bb468-87cd-4f35-9a37-ffe535d2d7e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:56.856079 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=60 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:56.861962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b6bb468-87cd-4f35-9a37-ffe535d2d7e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:56.862462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b6bb468-87cd-4f35-9a37-ffe535d2d7e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:56.863273 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b6bb468-87cd-4f35-9a37-ffe535d2d7e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:56.863709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b6bb468-87cd-4f35-9a37-ffe535d2d7e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:56.864305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:56.866012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:56.867778 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3bc62f1b-86d5-4211-a34a-d04a7b92f2fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.183352 Jun 15 10:14:56.878384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 113/226] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:56 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:14:57.004108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8b6bb468-87cd-4f35-9a37-ffe535d2d7e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:57.012259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8b6bb468-87cd-4f35-9a37-ffe535d2d7e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1321 microversion: 2.1 time: 0.164591 Jun 15 10:14:57.012824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 114/227] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:56 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:57.888362 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:57.888985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:57.895273 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:57.895727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:57.896492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:57.897095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:58.029696 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f82cf60b-90b6-40c9-b51b-068109654069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:58.030373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f82cf60b-90b6-40c9-b51b-068109654069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:58.036960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f82cf60b-90b6-40c9-b51b-068109654069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:58.037432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f82cf60b-90b6-40c9-b51b-068109654069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:58.038205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f82cf60b-90b6-40c9-b51b-068109654069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:58.038672 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f82cf60b-90b6-40c9-b51b-068109654069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:58.120584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:58.131029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:58.132787 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:58.134111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b38e3630-a8df-486c-bc49-107e3dd28fa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.249794 Jun 15 10:14:58.135071 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 114/228] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:57 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:58.216324 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f82cf60b-90b6-40c9-b51b-068109654069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:58.224249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f82cf60b-90b6-40c9-b51b-068109654069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1515 microversion: 2.1 time: 0.198679 Jun 15 10:14:58.224990 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 115/229] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:58 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:58.242105 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3fd428a0-829b-40af-853d-2ba48285e30f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:58.243192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3fd428a0-829b-40af-853d-2ba48285e30f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:58.249253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3fd428a0-829b-40af-853d-2ba48285e30f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:58.249705 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3fd428a0-829b-40af-853d-2ba48285e30f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:58.250511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3fd428a0-829b-40af-853d-2ba48285e30f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:58.250947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3fd428a0-829b-40af-853d-2ba48285e30f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:58.314072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-3fd428a0-829b-40af-853d-2ba48285e30f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lazy-loading 'flavor' on Instance uuid d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:14:58.455973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3fd428a0-829b-40af-853d-2ba48285e30f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf/action" status: 200 len: 32 microversion: 2.1 time: 0.217646 Jun 15 10:14:58.456642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 115/230] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:14:58 2022] POST /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:14:58.467580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-acfc0518-2ad1-4ac0-ae1d-ad2c708ed752 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:58.468624 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-acfc0518-2ad1-4ac0-ae1d-ad2c708ed752 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:58.479857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-acfc0518-2ad1-4ac0-ae1d-ad2c708ed752 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:58.480319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-acfc0518-2ad1-4ac0-ae1d-ad2c708ed752 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:58.481142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-acfc0518-2ad1-4ac0-ae1d-ad2c708ed752 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:58.481586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-acfc0518-2ad1-4ac0-ae1d-ad2c708ed752 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:58.717193 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-acfc0518-2ad1-4ac0-ae1d-ad2c708ed752 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:58.729922 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-acfc0518-2ad1-4ac0-ae1d-ad2c708ed752 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.268152 Jun 15 10:14:58.731079 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 116/231] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:58 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:59.157008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:59.158976 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:59.167695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:59.168422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:59.169583 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:59.170652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:59.428469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:59.445241 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:59.448442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:59.450037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d4705735-b715-456c-8365-c3fe3c382bfa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.301335 Jun 15 10:14:59.450633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 116/232] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:14:59 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:59.748594 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5e6a1c54-8501-48b9-aab7-5f365d0639f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:59.749202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5e6a1c54-8501-48b9-aab7-5f365d0639f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:14:59.756225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e6a1c54-8501-48b9-aab7-5f365d0639f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:59.756859 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e6a1c54-8501-48b9-aab7-5f365d0639f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:59.757817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e6a1c54-8501-48b9-aab7-5f365d0639f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:59.758249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e6a1c54-8501-48b9-aab7-5f365d0639f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:59.812740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-2893eaf0-636d-46ac-9278-e442cc201af4 req-0347c84e-6627-4553-b0dc-912cab7e15aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5ab626-a7eb-407e-b8a9-a768e57d4022", "name": "network-vif-plugged", "status": "completed", "tag": "2021b47d-9010-4d70-8020-0269285a0559"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:59.824309 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-2893eaf0-636d-46ac-9278-e442cc201af4 req-0347c84e-6627-4553-b0dc-912cab7e15aa service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:14:59.825120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-2893eaf0-636d-46ac-9278-e442cc201af4 req-0347c84e-6627-4553-b0dc-912cab7e15aa service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:14:59.844287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-2893eaf0-636d-46ac-9278-e442cc201af4 req-0347c84e-6627-4553-b0dc-912cab7e15aa service nova] Creating event network-vif-plugged:2021b47d-9010-4d70-8020-0269285a0559 for instance af5ab626-a7eb-407e-b8a9-a768e57d4022 on hv-cinder-83028 Jun 15 10:14:59.850406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-2893eaf0-636d-46ac-9278-e442cc201af4 req-0347c84e-6627-4553-b0dc-912cab7e15aa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042338 Jun 15 10:14:59.851608 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 117/233] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:14:59.920792 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5e6a1c54-8501-48b9-aab7-5f365d0639f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:14:59.929917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5e6a1c54-8501-48b9-aab7-5f365d0639f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.184975 Jun 15 10:14:59.931132 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 117/234] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:14:59 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:00.470349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:00.471722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:00.478370 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:00.481795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:00.481795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:00.481795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:00.500618 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:00.631567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:00.644172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:00.646557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:00.647918 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7f4ef7e5-cd1a-40d5-858a-b2abbf50fc25 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.182776 Jun 15 10:15:00.648702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 118/235] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:15:00 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:00.950910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c3fe5094-26ab-4146-ac7f-9ea4c18b9b86 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:00.951798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c3fe5094-26ab-4146-ac7f-9ea4c18b9b86 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:00.958129 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3fe5094-26ab-4146-ac7f-9ea4c18b9b86 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:00.958688 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3fe5094-26ab-4146-ac7f-9ea4c18b9b86 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:00.959535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3fe5094-26ab-4146-ac7f-9ea4c18b9b86 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:00.959977 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3fe5094-26ab-4146-ac7f-9ea4c18b9b86 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:01.123304 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c3fe5094-26ab-4146-ac7f-9ea4c18b9b86 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:01.130962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c3fe5094-26ab-4146-ac7f-9ea4c18b9b86 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.183980 Jun 15 10:15:01.131527 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 118/236] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:00 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:01.665244 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:01.666077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:01.672164 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:01.672561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:01.673335 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:01.673784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:01.828647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:01.836617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:01.838853 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:01.840454 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-928e5d22-923b-44b1-a3c7-de109519be63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1406 microversion: 2.20 time: 0.178836 Jun 15 10:15:01.846843 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 119/237] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:15:01 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:02.150430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-305b74f9-1792-45d5-803b-cb3310d0b243 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:02.151391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-305b74f9-1792-45d5-803b-cb3310d0b243 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:02.158011 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-305b74f9-1792-45d5-803b-cb3310d0b243 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:02.158588 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-305b74f9-1792-45d5-803b-cb3310d0b243 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:02.159415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-305b74f9-1792-45d5-803b-cb3310d0b243 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:02.159918 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-305b74f9-1792-45d5-803b-cb3310d0b243 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:02.288809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-305b74f9-1792-45d5-803b-cb3310d0b243 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:02.297022 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-305b74f9-1792-45d5-803b-cb3310d0b243 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.150911 Jun 15 10:15:02.297615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 119/238] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:02 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:02.858165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:02.859148 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:02.866446 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:02.866902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:02.867690 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:02.868129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:03.015208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:03.023529 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:03.026078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:03.027943 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2f0eb969-f139-4277-bf4e-db73dc98eb83 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1597 microversion: 2.20 time: 0.174374 Jun 15 10:15:03.028515 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 120/239] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:15:02 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:03.046759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-20622095-a854-40d6-a126-e526be5f4576 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:03.047326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-20622095-a854-40d6-a126-e526be5f4576 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:03.055300 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-20622095-a854-40d6-a126-e526be5f4576 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:03.055811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-20622095-a854-40d6-a126-e526be5f4576 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:03.056764 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-20622095-a854-40d6-a126-e526be5f4576 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:03.057216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-20622095-a854-40d6-a126-e526be5f4576 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:03.145980 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-20622095-a854-40d6-a126-e526be5f4576 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103395 Jun 15 10:15:03.146831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 120/240] 10.222.0.57 () {60 vars in 1315 bytes} [Wed Jun 15 10:15:03 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:15:03.315352 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cb19f818-8022-4006-8744-2f08e6681262 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:03.316094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cb19f818-8022-4006-8744-2f08e6681262 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:03.323829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb19f818-8022-4006-8744-2f08e6681262 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:03.324282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb19f818-8022-4006-8744-2f08e6681262 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:03.325080 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb19f818-8022-4006-8744-2f08e6681262 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:03.327611 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb19f818-8022-4006-8744-2f08e6681262 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:03.489247 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cb19f818-8022-4006-8744-2f08e6681262 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:03.498580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cb19f818-8022-4006-8744-2f08e6681262 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.187168 Jun 15 10:15:03.499284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 121/241] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:03 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:04.517487 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8a857149-8de9-4852-aad9-6aff3d654222 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:04.518943 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8a857149-8de9-4852-aad9-6aff3d654222 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:04.526904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a857149-8de9-4852-aad9-6aff3d654222 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:04.527612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a857149-8de9-4852-aad9-6aff3d654222 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:04.528593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a857149-8de9-4852-aad9-6aff3d654222 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:04.529276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a857149-8de9-4852-aad9-6aff3d654222 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:04.678736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a857149-8de9-4852-aad9-6aff3d654222 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:04.687778 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8a857149-8de9-4852-aad9-6aff3d654222 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.175201 Jun 15 10:15:04.688629 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 121/242] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:04 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:04.761948 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-cc3387cc-923e-4c5c-be00-42f74c2e4977 req-c837d5c9-906c-4886-b49e-567b1127604c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af5ab626-a7eb-407e-b8a9-a768e57d4022", "tag": "2021b47d-9010-4d70-8020-0269285a0559"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:04.769771 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-cc3387cc-923e-4c5c-be00-42f74c2e4977 req-c837d5c9-906c-4886-b49e-567b1127604c service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:04.770227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-cc3387cc-923e-4c5c-be00-42f74c2e4977 req-c837d5c9-906c-4886-b49e-567b1127604c service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:04.785770 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-cc3387cc-923e-4c5c-be00-42f74c2e4977 req-c837d5c9-906c-4886-b49e-567b1127604c service nova] Creating event network-changed:2021b47d-9010-4d70-8020-0269285a0559 for instance af5ab626-a7eb-407e-b8a9-a768e57d4022 on hv-cinder-83028 Jun 15 10:15:04.790957 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-cc3387cc-923e-4c5c-be00-42f74c2e4977 req-c837d5c9-906c-4886-b49e-567b1127604c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033094 Jun 15 10:15:04.792185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 122/243] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:05.705056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f52937ba-8310-433f-8c67-7ce4e27785f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:05.705665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f52937ba-8310-433f-8c67-7ce4e27785f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:05.712260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f52937ba-8310-433f-8c67-7ce4e27785f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:05.713375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f52937ba-8310-433f-8c67-7ce4e27785f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:05.714725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f52937ba-8310-433f-8c67-7ce4e27785f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:05.715168 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f52937ba-8310-433f-8c67-7ce4e27785f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:06.036304 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f52937ba-8310-433f-8c67-7ce4e27785f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:06.044243 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f52937ba-8310-433f-8c67-7ce4e27785f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.342834 Jun 15 10:15:06.044878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 122/244] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:05 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:07.061555 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4f34e9a5-3f12-4101-a133-aec19c959162 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:07.062311 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4f34e9a5-3f12-4101-a133-aec19c959162 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:07.068739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f34e9a5-3f12-4101-a133-aec19c959162 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:07.069266 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f34e9a5-3f12-4101-a133-aec19c959162 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:07.070036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f34e9a5-3f12-4101-a133-aec19c959162 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:07.070551 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f34e9a5-3f12-4101-a133-aec19c959162 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:07.209050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4f34e9a5-3f12-4101-a133-aec19c959162 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:07.217140 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4f34e9a5-3f12-4101-a133-aec19c959162 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.160005 Jun 15 10:15:07.217696 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 123/245] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:07 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:08.235161 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-60323d25-bec0-4e8e-be59-a587787d290d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:08.235831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-60323d25-bec0-4e8e-be59-a587787d290d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:08.242291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-60323d25-bec0-4e8e-be59-a587787d290d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:08.242756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-60323d25-bec0-4e8e-be59-a587787d290d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:08.243525 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-60323d25-bec0-4e8e-be59-a587787d290d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:08.243968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-60323d25-bec0-4e8e-be59-a587787d290d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:08.576241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-60323d25-bec0-4e8e-be59-a587787d290d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:08.584335 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-60323d25-bec0-4e8e-be59-a587787d290d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.353196 Jun 15 10:15:08.585070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 123/246] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:08 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:08.680734 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3e576e24-40e7-463b-bc89-e1fd0c8383ed tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:08.681300 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3e576e24-40e7-463b-bc89-e1fd0c8383ed tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:08.703061 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3e576e24-40e7-463b-bc89-e1fd0c8383ed tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:08.703904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3e576e24-40e7-463b-bc89-e1fd0c8383ed tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:08.705278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3e576e24-40e7-463b-bc89-e1fd0c8383ed tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:08.705562 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3e576e24-40e7-463b-bc89-e1fd0c8383ed tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:08.740910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3e576e24-40e7-463b-bc89-e1fd0c8383ed tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:15:08.895607 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3e576e24-40e7-463b-bc89-e1fd0c8383ed tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "DELETE /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 204 len: 0 microversion: 2.1 time: 0.218363 Jun 15 10:15:08.905903 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d4945ccf-f271-46fe-b6fe-82b55e1f0d7a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:08.906351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 124/247] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:15:08 2022] DELETE /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:15:08.906880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d4945ccf-f271-46fe-b6fe-82b55e1f0d7a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:08.919740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d4945ccf-f271-46fe-b6fe-82b55e1f0d7a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:08.920741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d4945ccf-f271-46fe-b6fe-82b55e1f0d7a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:08.921740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d4945ccf-f271-46fe-b6fe-82b55e1f0d7a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:08.922382 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d4945ccf-f271-46fe-b6fe-82b55e1f0d7a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:09.226143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d4945ccf-f271-46fe-b6fe-82b55e1f0d7a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:09.241192 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d4945ccf-f271-46fe-b6fe-82b55e1f0d7a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1552 microversion: 2.1 time: 0.338881 Jun 15 10:15:09.242426 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 124/248] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:08 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1552 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:09.602399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-edfbe954-a727-42fa-8408-5d1e10a3c529 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:09.603114 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-edfbe954-a727-42fa-8408-5d1e10a3c529 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:09.610087 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edfbe954-a727-42fa-8408-5d1e10a3c529 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:09.610863 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edfbe954-a727-42fa-8408-5d1e10a3c529 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:09.611668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edfbe954-a727-42fa-8408-5d1e10a3c529 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:09.612090 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edfbe954-a727-42fa-8408-5d1e10a3c529 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:09.794449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-edfbe954-a727-42fa-8408-5d1e10a3c529 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:09.804117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-edfbe954-a727-42fa-8408-5d1e10a3c529 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.205928 Jun 15 10:15:09.817105 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 125/249] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:09 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:10.259736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b250a868-3f19-48e3-aa90-a600f08d9538 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:10.260550 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b250a868-3f19-48e3-aa90-a600f08d9538 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:10.268033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b250a868-3f19-48e3-aa90-a600f08d9538 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:10.268900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b250a868-3f19-48e3-aa90-a600f08d9538 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:10.269877 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b250a868-3f19-48e3-aa90-a600f08d9538 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:10.270424 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b250a868-3f19-48e3-aa90-a600f08d9538 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:10.451286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b250a868-3f19-48e3-aa90-a600f08d9538 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:10.461692 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b250a868-3f19-48e3-aa90-a600f08d9538 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1552 microversion: 2.1 time: 0.205836 Jun 15 10:15:10.462424 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 125/250] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:10 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1552 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:10.821461 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9c2286f0-3990-40f7-9d6c-417f58300f1c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:10.822065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9c2286f0-3990-40f7-9d6c-417f58300f1c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:10.832733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c2286f0-3990-40f7-9d6c-417f58300f1c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:10.833186 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c2286f0-3990-40f7-9d6c-417f58300f1c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:10.833959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c2286f0-3990-40f7-9d6c-417f58300f1c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:10.834422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c2286f0-3990-40f7-9d6c-417f58300f1c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:10.986993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9c2286f0-3990-40f7-9d6c-417f58300f1c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:10.996416 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9c2286f0-3990-40f7-9d6c-417f58300f1c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.178720 Jun 15 10:15:10.997094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 126/251] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:10 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:11.480876 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c2ab4d2-cb6b-4d80-9647-66efbd3b074f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:11.482615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8c2ab4d2-cb6b-4d80-9647-66efbd3b074f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:11.490191 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c2ab4d2-cb6b-4d80-9647-66efbd3b074f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:11.490762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c2ab4d2-cb6b-4d80-9647-66efbd3b074f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:11.491747 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c2ab4d2-cb6b-4d80-9647-66efbd3b074f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:11.492377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c2ab4d2-cb6b-4d80-9647-66efbd3b074f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:11.654439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c2ab4d2-cb6b-4d80-9647-66efbd3b074f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:11.663115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8c2ab4d2-cb6b-4d80-9647-66efbd3b074f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1552 microversion: 2.1 time: 0.187777 Jun 15 10:15:11.663704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 126/252] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:11 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:12.014495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-071c2944-17fa-47df-9612-1704f22dc0e0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:12.015221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-071c2944-17fa-47df-9612-1704f22dc0e0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:12.021387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-071c2944-17fa-47df-9612-1704f22dc0e0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:12.021761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-071c2944-17fa-47df-9612-1704f22dc0e0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:12.022557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-071c2944-17fa-47df-9612-1704f22dc0e0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:12.022987 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-071c2944-17fa-47df-9612-1704f22dc0e0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:12.162712 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-071c2944-17fa-47df-9612-1704f22dc0e0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:12.172857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-071c2944-17fa-47df-9612-1704f22dc0e0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.162113 Jun 15 10:15:12.174093 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 127/253] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:12 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:12.680629 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e8805658-9628-43d7-b23c-6ea940dc6c48 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:12.681246 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e8805658-9628-43d7-b23c-6ea940dc6c48 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:12.688275 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8805658-9628-43d7-b23c-6ea940dc6c48 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:12.688728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8805658-9628-43d7-b23c-6ea940dc6c48 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:12.689568 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8805658-9628-43d7-b23c-6ea940dc6c48 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:12.690313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8805658-9628-43d7-b23c-6ea940dc6c48 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:12.829801 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e8805658-9628-43d7-b23c-6ea940dc6c48 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:12.837584 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e8805658-9628-43d7-b23c-6ea940dc6c48 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1552 microversion: 2.1 time: 0.161026 Jun 15 10:15:12.838782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 127/254] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:12 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:13.190370 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-809eed7a-1def-4259-9b88-d13699f3fc3f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:13.190981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-809eed7a-1def-4259-9b88-d13699f3fc3f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:13.197106 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-809eed7a-1def-4259-9b88-d13699f3fc3f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:13.198203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-809eed7a-1def-4259-9b88-d13699f3fc3f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:13.199014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-809eed7a-1def-4259-9b88-d13699f3fc3f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:13.199451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-809eed7a-1def-4259-9b88-d13699f3fc3f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:13.323198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-809eed7a-1def-4259-9b88-d13699f3fc3f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:13.330470 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-809eed7a-1def-4259-9b88-d13699f3fc3f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.143971 Jun 15 10:15:13.331043 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 128/255] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:13 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:13.855784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e03f1516-7c4b-4c90-94e4-e6d05766eee2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:13.856335 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e03f1516-7c4b-4c90-94e4-e6d05766eee2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:13.863162 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e03f1516-7c4b-4c90-94e4-e6d05766eee2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:13.863601 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e03f1516-7c4b-4c90-94e4-e6d05766eee2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:13.864354 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e03f1516-7c4b-4c90-94e4-e6d05766eee2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:13.864785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e03f1516-7c4b-4c90-94e4-e6d05766eee2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:13.878968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:13.996250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e03f1516-7c4b-4c90-94e4-e6d05766eee2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:14.004068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e03f1516-7c4b-4c90-94e4-e6d05766eee2 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1552 microversion: 2.1 time: 0.153159 Jun 15 10:15:14.004631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 128/256] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:13 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:14.347270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-38d3d3a9-c606-4653-9e5f-6f9ba3eb7c89 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:14.347877 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-38d3d3a9-c606-4653-9e5f-6f9ba3eb7c89 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:14.354303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-38d3d3a9-c606-4653-9e5f-6f9ba3eb7c89 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:14.354834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-38d3d3a9-c606-4653-9e5f-6f9ba3eb7c89 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:14.355589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-38d3d3a9-c606-4653-9e5f-6f9ba3eb7c89 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:14.356020 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-38d3d3a9-c606-4653-9e5f-6f9ba3eb7c89 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:14.482211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-38d3d3a9-c606-4653-9e5f-6f9ba3eb7c89 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:14.489784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-38d3d3a9-c606-4653-9e5f-6f9ba3eb7c89 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.146352 Jun 15 10:15:14.490372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 129/257] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:14 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:15.020800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5afe5e86-33ce-403d-acc2-9c5adb6de5b9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:15.021403 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5afe5e86-33ce-403d-acc2-9c5adb6de5b9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:15.027980 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5afe5e86-33ce-403d-acc2-9c5adb6de5b9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:15.028431 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5afe5e86-33ce-403d-acc2-9c5adb6de5b9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:15.029182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5afe5e86-33ce-403d-acc2-9c5adb6de5b9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:15.029613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5afe5e86-33ce-403d-acc2-9c5adb6de5b9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:15.158970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5afe5e86-33ce-403d-acc2-9c5adb6de5b9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:15.167561 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5afe5e86-33ce-403d-acc2-9c5adb6de5b9 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1552 microversion: 2.1 time: 0.150415 Jun 15 10:15:15.168132 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 129/258] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:15 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:15.506602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cd7b6e4a-a478-4301-9002-06053e718b7c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:15.507214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cd7b6e4a-a478-4301-9002-06053e718b7c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:15.513672 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cd7b6e4a-a478-4301-9002-06053e718b7c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:15.514117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cd7b6e4a-a478-4301-9002-06053e718b7c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:15.514903 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cd7b6e4a-a478-4301-9002-06053e718b7c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:15.515344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cd7b6e4a-a478-4301-9002-06053e718b7c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:15.641758 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cd7b6e4a-a478-4301-9002-06053e718b7c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:15.649262 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cd7b6e4a-a478-4301-9002-06053e718b7c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.146570 Jun 15 10:15:15.649817 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 130/259] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:15 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:16.184083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1f9d62c0-3df9-4456-90b5-61a78a90f8d1 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:16.184683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1f9d62c0-3df9-4456-90b5-61a78a90f8d1 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:16.191117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f9d62c0-3df9-4456-90b5-61a78a90f8d1 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:16.191560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f9d62c0-3df9-4456-90b5-61a78a90f8d1 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:16.192306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f9d62c0-3df9-4456-90b5-61a78a90f8d1 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:16.192734 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f9d62c0-3df9-4456-90b5-61a78a90f8d1 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:16.319939 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1f9d62c0-3df9-4456-90b5-61a78a90f8d1 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:16.327919 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1f9d62c0-3df9-4456-90b5-61a78a90f8d1 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1552 microversion: 2.1 time: 0.148118 Jun 15 10:15:16.328513 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 130/260] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:16 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:16.668669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-60f6ccfa-6339-4c8e-ac6a-71abac41a119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:16.669314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-60f6ccfa-6339-4c8e-ac6a-71abac41a119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:16.675455 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60f6ccfa-6339-4c8e-ac6a-71abac41a119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:16.675911 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60f6ccfa-6339-4c8e-ac6a-71abac41a119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:16.676679 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60f6ccfa-6339-4c8e-ac6a-71abac41a119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:16.677189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60f6ccfa-6339-4c8e-ac6a-71abac41a119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:16.812751 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-60f6ccfa-6339-4c8e-ac6a-71abac41a119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:16.820732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-60f6ccfa-6339-4c8e-ac6a-71abac41a119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.157386 Jun 15 10:15:16.821449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 131/261] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:16 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:17.345529 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b9b3a0c8-b405-4467-9894-c8f532ec7465 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:17.346141 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b9b3a0c8-b405-4467-9894-c8f532ec7465 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:17.353063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b9b3a0c8-b405-4467-9894-c8f532ec7465 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:17.354434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b9b3a0c8-b405-4467-9894-c8f532ec7465 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:17.354923 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b9b3a0c8-b405-4467-9894-c8f532ec7465 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:17.355362 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b9b3a0c8-b405-4467-9894-c8f532ec7465 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:17.680405 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b9b3a0c8-b405-4467-9894-c8f532ec7465 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:17.699259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b9b3a0c8-b405-4467-9894-c8f532ec7465 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1552 microversion: 2.1 time: 0.357405 Jun 15 10:15:17.699990 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 131/262] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:17 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1552 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:17.762106 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-30eec9e5-86d3-4104-a106-035ad46529be req-262e43bb-2ab4-4be9-905f-a6de222890b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a", "name": "network-vif-deleted", "tag": "4f233b8f-c4be-4757-8284-4c4bc12427d9"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:17.770669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-30eec9e5-86d3-4104-a106-035ad46529be req-262e43bb-2ab4-4be9-905f-a6de222890b6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:17.771155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-30eec9e5-86d3-4104-a106-035ad46529be req-262e43bb-2ab4-4be9-905f-a6de222890b6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:17.784201 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-30eec9e5-86d3-4104-a106-035ad46529be req-262e43bb-2ab4-4be9-905f-a6de222890b6 service nova] Creating event network-vif-deleted:4f233b8f-c4be-4757-8284-4c4bc12427d9 for instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a on hv-cinder-83028 Jun 15 10:15:17.789018 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-30eec9e5-86d3-4104-a106-035ad46529be req-262e43bb-2ab4-4be9-905f-a6de222890b6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031300 Jun 15 10:15:17.789591 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 132/263] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:17.837271 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-747c3b3a-af5f-4d20-af8c-3b479534e240 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:17.838771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-747c3b3a-af5f-4d20-af8c-3b479534e240 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:17.844934 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-747c3b3a-af5f-4d20-af8c-3b479534e240 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:17.845399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-747c3b3a-af5f-4d20-af8c-3b479534e240 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:17.846151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-747c3b3a-af5f-4d20-af8c-3b479534e240 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:17.846622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-747c3b3a-af5f-4d20-af8c-3b479534e240 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:17.984614 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-747c3b3a-af5f-4d20-af8c-3b479534e240 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:17.992757 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-747c3b3a-af5f-4d20-af8c-3b479534e240 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.159203 Jun 15 10:15:17.993331 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 132/264] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:17 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:18.716372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-42899c90-b6d4-44e3-a2e7-7d4f644fb980 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:18.718233 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-42899c90-b6d4-44e3-a2e7-7d4f644fb980 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:18.723782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-42899c90-b6d4-44e3-a2e7-7d4f644fb980 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:18.724238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-42899c90-b6d4-44e3-a2e7-7d4f644fb980 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:18.725003 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-42899c90-b6d4-44e3-a2e7-7d4f644fb980 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:18.725437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-42899c90-b6d4-44e3-a2e7-7d4f644fb980 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:18.927151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-42899c90-b6d4-44e3-a2e7-7d4f644fb980 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:18.935688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-42899c90-b6d4-44e3-a2e7-7d4f644fb980 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1510 microversion: 2.1 time: 0.223638 Jun 15 10:15:18.936244 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 133/265] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:18 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:19.010025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-333d9dc3-0f94-4761-879d-281b5e2f70f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:19.010755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-333d9dc3-0f94-4761-879d-281b5e2f70f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:19.017382 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-333d9dc3-0f94-4761-879d-281b5e2f70f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:19.017837 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-333d9dc3-0f94-4761-879d-281b5e2f70f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:19.018630 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-333d9dc3-0f94-4761-879d-281b5e2f70f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:19.019067 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-333d9dc3-0f94-4761-879d-281b5e2f70f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:19.149579 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-333d9dc3-0f94-4761-879d-281b5e2f70f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:19.157708 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-333d9dc3-0f94-4761-879d-281b5e2f70f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.151419 Jun 15 10:15:19.158317 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 133/266] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:19 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:19.953054 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-744cfda0-647d-40f5-90ef-7fdd15c52c8f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:19.953671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-744cfda0-647d-40f5-90ef-7fdd15c52c8f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:19.959741 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-744cfda0-647d-40f5-90ef-7fdd15c52c8f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:19.960202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-744cfda0-647d-40f5-90ef-7fdd15c52c8f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:19.960940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-744cfda0-647d-40f5-90ef-7fdd15c52c8f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:19.961372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-744cfda0-647d-40f5-90ef-7fdd15c52c8f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:20.022746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-744cfda0-647d-40f5-90ef-7fdd15c52c8f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:20.025260 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:20.032908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-744cfda0-647d-40f5-90ef-7fdd15c52c8f tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1345 microversion: 2.1 time: 0.083751 Jun 15 10:15:20.033469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 134/267] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:19 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:20.175211 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e6ee9558-6681-4352-bf3c-90fd6cb177fc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:20.175826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e6ee9558-6681-4352-bf3c-90fd6cb177fc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:20.181990 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e6ee9558-6681-4352-bf3c-90fd6cb177fc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:20.182498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e6ee9558-6681-4352-bf3c-90fd6cb177fc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:20.183262 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e6ee9558-6681-4352-bf3c-90fd6cb177fc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:20.183703 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e6ee9558-6681-4352-bf3c-90fd6cb177fc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:20.315459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e6ee9558-6681-4352-bf3c-90fd6cb177fc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:20.323574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e6ee9558-6681-4352-bf3c-90fd6cb177fc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.152254 Jun 15 10:15:20.324174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 134/268] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:20 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:21.048372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-01c29018-531a-414f-925c-1989e4e7a348 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:21.049077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-01c29018-531a-414f-925c-1989e4e7a348 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:21.057281 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01c29018-531a-414f-925c-1989e4e7a348 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:21.057834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01c29018-531a-414f-925c-1989e4e7a348 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:21.058632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01c29018-531a-414f-925c-1989e4e7a348 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:21.059076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-01c29018-531a-414f-925c-1989e4e7a348 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:21.121783 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-01c29018-531a-414f-925c-1989e4e7a348 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:21.129711 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-01c29018-531a-414f-925c-1989e4e7a348 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1345 microversion: 2.1 time: 0.085128 Jun 15 10:15:21.130303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 135/269] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:21 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:21.340556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c925c4a7-1463-4870-94b7-3d9604ff62d5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:21.341090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c925c4a7-1463-4870-94b7-3d9604ff62d5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:21.347522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c925c4a7-1463-4870-94b7-3d9604ff62d5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:21.347969 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c925c4a7-1463-4870-94b7-3d9604ff62d5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:21.348715 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c925c4a7-1463-4870-94b7-3d9604ff62d5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:21.349145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c925c4a7-1463-4870-94b7-3d9604ff62d5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:21.488901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c925c4a7-1463-4870-94b7-3d9604ff62d5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:21.496558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c925c4a7-1463-4870-94b7-3d9604ff62d5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.160074 Jun 15 10:15:21.497117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 135/270] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:21 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:22.146951 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6c4fb3fe-8111-439f-9e56-9fc84d6e1e93 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:22.147562 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6c4fb3fe-8111-439f-9e56-9fc84d6e1e93 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:22.154791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c4fb3fe-8111-439f-9e56-9fc84d6e1e93 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:22.155234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c4fb3fe-8111-439f-9e56-9fc84d6e1e93 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:22.155996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c4fb3fe-8111-439f-9e56-9fc84d6e1e93 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:22.156436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c4fb3fe-8111-439f-9e56-9fc84d6e1e93 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:22.218107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6c4fb3fe-8111-439f-9e56-9fc84d6e1e93 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:22.227434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6c4fb3fe-8111-439f-9e56-9fc84d6e1e93 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1345 microversion: 2.1 time: 0.084470 Jun 15 10:15:22.228286 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 136/271] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:22 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:22.513821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bec0f242-bf4b-4b31-8f49-cd75b287c8fb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:22.514473 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bec0f242-bf4b-4b31-8f49-cd75b287c8fb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:22.520826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bec0f242-bf4b-4b31-8f49-cd75b287c8fb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:22.521270 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bec0f242-bf4b-4b31-8f49-cd75b287c8fb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:22.522049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bec0f242-bf4b-4b31-8f49-cd75b287c8fb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:22.522507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bec0f242-bf4b-4b31-8f49-cd75b287c8fb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:22.663469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bec0f242-bf4b-4b31-8f49-cd75b287c8fb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:22.672697 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bec0f242-bf4b-4b31-8f49-cd75b287c8fb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.163367 Jun 15 10:15:22.673298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 136/272] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:22 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:23.245107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9a8cf3ef-2911-47a3-8132-ad38f4a1d1ce tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:23.245723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9a8cf3ef-2911-47a3-8132-ad38f4a1d1ce tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:23.251889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a8cf3ef-2911-47a3-8132-ad38f4a1d1ce tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:23.252339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a8cf3ef-2911-47a3-8132-ad38f4a1d1ce tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:23.253106 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a8cf3ef-2911-47a3-8132-ad38f4a1d1ce tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:23.253616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9a8cf3ef-2911-47a3-8132-ad38f4a1d1ce tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:23.316125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9a8cf3ef-2911-47a3-8132-ad38f4a1d1ce tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:23.324404 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9a8cf3ef-2911-47a3-8132-ad38f4a1d1ce tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1345 microversion: 2.1 time: 0.083766 Jun 15 10:15:23.324963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 137/273] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:23 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:23.690795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-73b954d5-1133-46ba-9027-1182b8b2f216 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:23.691408 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-73b954d5-1133-46ba-9027-1182b8b2f216 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:23.698917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73b954d5-1133-46ba-9027-1182b8b2f216 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:23.699423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73b954d5-1133-46ba-9027-1182b8b2f216 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:23.700156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73b954d5-1133-46ba-9027-1182b8b2f216 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:23.700627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73b954d5-1133-46ba-9027-1182b8b2f216 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:23.837135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73b954d5-1133-46ba-9027-1182b8b2f216 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:23.844857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-73b954d5-1133-46ba-9027-1182b8b2f216 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.157911 Jun 15 10:15:23.845444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 137/274] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:23 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:24.340890 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7a003943-e74c-4b97-af4a-7c60f92b800a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:24.341507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7a003943-e74c-4b97-af4a-7c60f92b800a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:24.343391 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:24.348847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7a003943-e74c-4b97-af4a-7c60f92b800a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:24.349297 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7a003943-e74c-4b97-af4a-7c60f92b800a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:24.350056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7a003943-e74c-4b97-af4a-7c60f92b800a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:24.350518 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7a003943-e74c-4b97-af4a-7c60f92b800a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:24.413039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7a003943-e74c-4b97-af4a-7c60f92b800a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506c7cbec190453cabb8fd8049a14cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f1dab6f20e41308d7d4a58e42140d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:24.421577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7a003943-e74c-4b97-af4a-7c60f92b800a tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 200 len: 1345 microversion: 2.1 time: 0.084620 Jun 15 10:15:24.422138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 138/275] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:24 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:24.863732 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-da1c5b7e-4b8f-4bde-ae65-971f65584dd9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:24.864389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-da1c5b7e-4b8f-4bde-ae65-971f65584dd9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:24.872152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da1c5b7e-4b8f-4bde-ae65-971f65584dd9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:24.872621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da1c5b7e-4b8f-4bde-ae65-971f65584dd9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:24.873399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da1c5b7e-4b8f-4bde-ae65-971f65584dd9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:24.873831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da1c5b7e-4b8f-4bde-ae65-971f65584dd9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:25.148475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-da1c5b7e-4b8f-4bde-ae65-971f65584dd9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:25.157552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-da1c5b7e-4b8f-4bde-ae65-971f65584dd9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.298655 Jun 15 10:15:25.158359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 138/276] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:24 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:25.439916 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:25.440542 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:25.446601 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:25.447223 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:25.447996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:25.448438 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:25.463740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] HTTP exception thrown: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Request method failure captured: Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a HTTP/1.1 Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDGS8FRvNF_xySS0k5djFNeDwQW1rAj6lT7_ScBIC6H6Se9VlaxUVJ61HsiKZvqknd3vbKmy0XqqdHg29_K4A4d5w3CDuYiGgL_q-hCTf5IlORqbPGwTcVIkziRyyQdy0UjT7WSVE_5kBkNw5tlhlNXFX9ED1q53lRTE2Zt4yaZZNA Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: c5f1dab6f20e41308d7d4a58e42140d6 Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:15:25.468333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5f1dab6f20e41308d7d4a58e42140d6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: c5f1dab6f20e41308d7d4a58e42140d6 Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-DeleteServersTestJSON-2130061640-project Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 506c7cbec190453cabb8fd8049a14cf9 Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-DeleteServersTestJSON-2130061640-project Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.469813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a'} Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:25.470704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.472073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.473254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Returning 404 to user: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:25.473254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-aa4b4ade-4935-4a52-b203-66374686af16 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 404 len: 111 microversion: 2.1 time: 0.033699 Jun 15 10:15:25.473254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 139/277] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:25 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:15:25.581576 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:25.582609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:25.590194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:25.590670 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:25.591439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:25.591879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:25.604720 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] HTTP exception thrown: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Request method failure captured: Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a/os-volume_attachments HTTP/1.1 Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDGS8FRvNF_xySS0k5djFNeDwQW1rAj6lT7_ScBIC6H6Se9VlaxUVJ61HsiKZvqknd3vbKmy0XqqdHg29_K4A4d5w3CDuYiGgL_q-hCTf5IlORqbPGwTcVIkziRyyQdy0UjT7WSVE_5kBkNw5tlhlNXFX9ED1q53lRTE2Zt4yaZZNA Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: c5f1dab6f20e41308d7d4a58e42140d6 Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:15:25.608940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5f1dab6f20e41308d7d4a58e42140d6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c5f1dab6f20e41308d7d4a58e42140d6 Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-DeleteServersTestJSON-2130061640-project Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 506c7cbec190453cabb8fd8049a14cf9 Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-DeleteServersTestJSON-2130061640-project Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.610373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'server_id': '61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a'} Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:25.611210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:25.612606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:25.614059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Returning 404 to user: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:25.614059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-661f4d48-bb24-47c7-b313-3a4b7eed1c36 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032997 Jun 15 10:15:25.614059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 139/278] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:15:25 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:15:26.176701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c94c901d-2f7f-4395-87bb-d8195735c22b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:26.177251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c94c901d-2f7f-4395-87bb-d8195735c22b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:26.183971 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c94c901d-2f7f-4395-87bb-d8195735c22b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:26.184671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c94c901d-2f7f-4395-87bb-d8195735c22b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:26.186255 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c94c901d-2f7f-4395-87bb-d8195735c22b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:26.186719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c94c901d-2f7f-4395-87bb-d8195735c22b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:26.402000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c94c901d-2f7f-4395-87bb-d8195735c22b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:26.412120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c94c901d-2f7f-4395-87bb-d8195735c22b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.239207 Jun 15 10:15:26.413113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 140/279] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:26 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:26.817429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:26.817931 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:26.824898 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:26.825351 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:26.826115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:26.826581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:26.840056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] HTTP exception thrown: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Request method failure captured: Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a HTTP/1.1 Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDGS8FRvNF_xySS0k5djFNeDwQW1rAj6lT7_ScBIC6H6Se9VlaxUVJ61HsiKZvqknd3vbKmy0XqqdHg29_K4A4d5w3CDuYiGgL_q-hCTf5IlORqbPGwTcVIkziRyyQdy0UjT7WSVE_5kBkNw5tlhlNXFX9ED1q53lRTE2Zt4yaZZNA Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: c5f1dab6f20e41308d7d4a58e42140d6 Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:15:26.842206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5f1dab6f20e41308d7d4a58e42140d6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c5f1dab6f20e41308d7d4a58e42140d6 Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-DeleteServersTestJSON-2130061640-project Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 506c7cbec190453cabb8fd8049a14cf9 Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-DeleteServersTestJSON-2130061640-project Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.843569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a'} Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:26.844325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.845323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.846451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Returning 404 to user: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:26.846451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6cf1c97e-9c7a-49cd-a176-3f8361e9a909 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "DELETE /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 404 len: 111 microversion: 2.1 time: 0.030169 Jun 15 10:15:26.846451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 140/280] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:15:26 2022] DELETE /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:15:26.852099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:26.852717 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] [instance: 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:26.860600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:26.861040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:26.861967 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:26.862450 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:26.878117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] HTTP exception thrown: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Request method failure captured: Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a HTTP/1.1 Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDGS8FRvNF_xySS0k5djFNeDwQW1rAj6lT7_ScBIC6H6Se9VlaxUVJ61HsiKZvqknd3vbKmy0XqqdHg29_K4A4d5w3CDuYiGgL_q-hCTf5IlORqbPGwTcVIkziRyyQdy0UjT7WSVE_5kBkNw5tlhlNXFX9ED1q53lRTE2Zt4yaZZNA Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: c5f1dab6f20e41308d7d4a58e42140d6 Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:15:26.879680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c5f1dab6f20e41308d7d4a58e42140d6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c5f1dab6f20e41308d7d4a58e42140d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: c5f1dab6f20e41308d7d4a58e42140d6 Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-DeleteServersTestJSON-2130061640 Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-DeleteServersTestJSON-2130061640-project Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 506c7cbec190453cabb8fd8049a14cf9 Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-DeleteServersTestJSON-2130061640-project Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.881130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a'} Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:26.881921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. Jun 15 10:15:26.883331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:15:26.885298 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] Returning 404 to user: Instance 61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:26.885298 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fa152df9-c89c-4c4c-b7d6-32a5a2999693 tempest-DeleteServersTestJSON-2130061640 tempest-DeleteServersTestJSON-2130061640-project] 10.222.0.57 "GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a" status: 404 len: 111 microversion: 2.1 time: 0.032792 Jun 15 10:15:26.885298 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 141/281] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:26 2022] GET /compute/v2.1/servers/61fcf4d2-b8aa-425f-b5f7-dc79ce8c743a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:15:27.430786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6143c9df-64d5-4a5a-95a9-64c60b441cbd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:27.432270 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6143c9df-64d5-4a5a-95a9-64c60b441cbd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:27.435759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=54 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:27.440675 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6143c9df-64d5-4a5a-95a9-64c60b441cbd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:27.441133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6143c9df-64d5-4a5a-95a9-64c60b441cbd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:27.441912 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6143c9df-64d5-4a5a-95a9-64c60b441cbd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:27.442384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6143c9df-64d5-4a5a-95a9-64c60b441cbd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:27.757468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6143c9df-64d5-4a5a-95a9-64c60b441cbd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:27.766659 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6143c9df-64d5-4a5a-95a9-64c60b441cbd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.339881 Jun 15 10:15:27.767474 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 141/282] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:27 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:28.789320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c78a8f32-d714-4802-9d8b-60dcb61caa10 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:28.789320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c78a8f32-d714-4802-9d8b-60dcb61caa10 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:28.791310 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c78a8f32-d714-4802-9d8b-60dcb61caa10 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:28.792097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c78a8f32-d714-4802-9d8b-60dcb61caa10 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:28.792937 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c78a8f32-d714-4802-9d8b-60dcb61caa10 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:28.793380 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c78a8f32-d714-4802-9d8b-60dcb61caa10 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:28.968420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c78a8f32-d714-4802-9d8b-60dcb61caa10 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:28.979137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c78a8f32-d714-4802-9d8b-60dcb61caa10 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.198738 Jun 15 10:15:28.991884 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 142/283] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:28 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:29.996496 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cf773046-d781-4515-886d-fb07884a165f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:29.997099 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cf773046-d781-4515-886d-fb07884a165f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:30.004074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf773046-d781-4515-886d-fb07884a165f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:30.004615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf773046-d781-4515-886d-fb07884a165f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:30.005464 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf773046-d781-4515-886d-fb07884a165f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:30.006237 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf773046-d781-4515-886d-fb07884a165f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:30.270468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cf773046-d781-4515-886d-fb07884a165f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:30.281135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cf773046-d781-4515-886d-fb07884a165f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.288814 Jun 15 10:15:30.294220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 142/284] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:29 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:30.820806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-868615386", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "networks": [{"uuid": "fcc15d63-bcf1-4fa7-8d0e-6837e0713812"}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:30.879148 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] validate_networks() for [('fcc15d63-bcf1-4fa7-8d0e-6837e0713812', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:15:31.301229 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bc5dd00f-cbd7-4538-82c9-4917004cce04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:31.302585 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bc5dd00f-cbd7-4538-82c9-4917004cce04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:31.309978 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc5dd00f-cbd7-4538-82c9-4917004cce04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:31.310423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc5dd00f-cbd7-4538-82c9-4917004cce04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:31.311070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc5dd00f-cbd7-4538-82c9-4917004cce04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:31.311515 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc5dd00f-cbd7-4538-82c9-4917004cce04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:31.777975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bc5dd00f-cbd7-4538-82c9-4917004cce04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:31.786386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bc5dd00f-cbd7-4538-82c9-4917004cce04 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.489206 Jun 15 10:15:31.787153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 143/285] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:31 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:31.822152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:15:31.823397 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:15:31.823882 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:15:31.824461 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:15:31.824865 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:15:31.835725 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:31.836181 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:31.836978 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:31.839070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:31.858001 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Getting quotas for project 6344b21c92314593b43addf9a8f21100. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:15:31.862450 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Getting quotas for user 8c4fd4257ccd492a8ecf3dfb731cb142 and project 6344b21c92314593b43addf9a8f21100. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:15:31.875484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:15:31.877739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:15:31.929019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2d16c715-5084-4530-965b-d738e2fadbcb tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112292 Jun 15 10:15:31.929683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 143/286] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:15:31.942074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ed1a57cd-0688-4d44-b906-180ede6de6e8 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:31.943479 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ed1a57cd-0688-4d44-b906-180ede6de6e8 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:32.020139 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ed1a57cd-0688-4d44-b906-180ede6de6e8 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:32.029057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ed1a57cd-0688-4d44-b906-180ede6de6e8 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1218 microversion: 2.1 time: 0.090729 Jun 15 10:15:32.030093 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 144/287] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:31 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:32.814487 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-22e76ad6-64fc-4393-976e-25ea21b2f256 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:32.815839 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-22e76ad6-64fc-4393-976e-25ea21b2f256 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:32.851775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22e76ad6-64fc-4393-976e-25ea21b2f256 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:32.854166 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22e76ad6-64fc-4393-976e-25ea21b2f256 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:32.855110 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22e76ad6-64fc-4393-976e-25ea21b2f256 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:32.860212 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22e76ad6-64fc-4393-976e-25ea21b2f256 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:33.052279 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-563f6a64-7787-4239-85c2-a3e72f5ae906 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:33.055943 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-563f6a64-7787-4239-85c2-a3e72f5ae906 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:33.075957 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-563f6a64-7787-4239-85c2-a3e72f5ae906 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:33.076892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-563f6a64-7787-4239-85c2-a3e72f5ae906 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:33.084153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-563f6a64-7787-4239-85c2-a3e72f5ae906 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:33.085145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-563f6a64-7787-4239-85c2-a3e72f5ae906 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:33.087972 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-22e76ad6-64fc-4393-976e-25ea21b2f256 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:33.107564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-22e76ad6-64fc-4393-976e-25ea21b2f256 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.307381 Jun 15 10:15:33.108726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 144/288] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:32 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:33.215834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-563f6a64-7787-4239-85c2-a3e72f5ae906 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:33.238792 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-563f6a64-7787-4239-85c2-a3e72f5ae906 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1270 microversion: 2.1 time: 0.195183 Jun 15 10:15:33.255131 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 145/289] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:33 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:34.125834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f63745af-cae5-4300-9d2f-1b113fc7401e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:34.127054 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f63745af-cae5-4300-9d2f-1b113fc7401e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:34.160510 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f63745af-cae5-4300-9d2f-1b113fc7401e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:34.160987 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f63745af-cae5-4300-9d2f-1b113fc7401e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:34.164048 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f63745af-cae5-4300-9d2f-1b113fc7401e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:34.167562 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f63745af-cae5-4300-9d2f-1b113fc7401e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:34.264435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b1edfc96-8afa-4eae-a014-c6d17180cfe1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:34.265052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b1edfc96-8afa-4eae-a014-c6d17180cfe1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:34.272255 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1edfc96-8afa-4eae-a014-c6d17180cfe1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:34.272959 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1edfc96-8afa-4eae-a014-c6d17180cfe1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:34.273937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1edfc96-8afa-4eae-a014-c6d17180cfe1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:34.275124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1edfc96-8afa-4eae-a014-c6d17180cfe1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:34.594208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f63745af-cae5-4300-9d2f-1b113fc7401e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:34.605894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b1edfc96-8afa-4eae-a014-c6d17180cfe1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:34.608635 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f63745af-cae5-4300-9d2f-1b113fc7401e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.485983 Jun 15 10:15:34.609867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 145/290] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:34 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:34.619794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b1edfc96-8afa-4eae-a014-c6d17180cfe1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.355658 Jun 15 10:15:34.619794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 146/291] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:34 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:34.902955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a4b7e444-a894-436c-a6ca-4f41ea7d9560 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'create', calling method: .version_select at 0x7fe256171820>, body: {"keypair": {"name": "tempest-keypair-1483562710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgIceXFGEaJcPQ+xOTD7ivJdkq6CLymiUWOipbrSh9EmsjkyuhTt3Jk35HuqYp6NgFEMRP97/AuVzojVgARnmaDXEQVEqXeFUoAGkdyWELdQ4hV8fxFTUV7hKrH4pthfw=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:34.920505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-a4b7e444-a894-436c-a6ca-4f41ea7d9560 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Getting quotas for project 36b6b134fac8433db72a937ba72e8a6c. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:15:34.924633 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-a4b7e444-a894-436c-a6ca-4f41ea7d9560 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Getting quotas for user a04041aca6d64274b7019fcd6ece608c and project 36b6b134fac8433db72a937ba72e8a6c. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:15:34.978965 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a4b7e444-a894-436c-a6ca-4f41ea7d9560 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.359101 Jun 15 10:15:34.979583 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 147/292] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:15:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:35.628607 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4c052f72-31a9-4b16-ac15-4e476329846f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:35.630232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4c052f72-31a9-4b16-ac15-4e476329846f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:35.632756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-06c2bec7-6ef8-41a9-b9df-d2cce1846b2d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:35.633373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-06c2bec7-6ef8-41a9-b9df-d2cce1846b2d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:35.640008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4c052f72-31a9-4b16-ac15-4e476329846f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:35.640555 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4c052f72-31a9-4b16-ac15-4e476329846f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:35.641560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4c052f72-31a9-4b16-ac15-4e476329846f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:35.642154 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4c052f72-31a9-4b16-ac15-4e476329846f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:35.645453 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06c2bec7-6ef8-41a9-b9df-d2cce1846b2d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:35.646069 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06c2bec7-6ef8-41a9-b9df-d2cce1846b2d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:35.646887 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06c2bec7-6ef8-41a9-b9df-d2cce1846b2d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:35.647410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06c2bec7-6ef8-41a9-b9df-d2cce1846b2d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:35.680707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:35.990981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4c052f72-31a9-4b16-ac15-4e476329846f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:36.004138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4c052f72-31a9-4b16-ac15-4e476329846f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.380536 Jun 15 10:15:36.004915 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 146/293] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:35 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:36.005661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-06c2bec7-6ef8-41a9-b9df-d2cce1846b2d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:36.020311 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-06c2bec7-6ef8-41a9-b9df-d2cce1846b2d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.391315 Jun 15 10:15:36.029254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 148/294] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:35 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:36.861055 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-264405643", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c016a67-5822-4687-821d-45e29fcf6683"}], "security_groups": [{"name": "tempest-securitygroup--832200133"}], "key_name": "tempest-keypair-1483562710", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:36.979369 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] validate_networks() for [('4c016a67-5822-4687-821d-45e29fcf6683', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:15:37.022048 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b1d5d3a1-cb95-4e07-9ac5-417b2ef9f3d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:37.023653 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b1d5d3a1-cb95-4e07-9ac5-417b2ef9f3d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:37.033021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1d5d3a1-cb95-4e07-9ac5-417b2ef9f3d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:37.033626 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1d5d3a1-cb95-4e07-9ac5-417b2ef9f3d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:37.034577 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1d5d3a1-cb95-4e07-9ac5-417b2ef9f3d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:37.035092 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b1d5d3a1-cb95-4e07-9ac5-417b2ef9f3d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:37.234051 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b1d5d3a1-cb95-4e07-9ac5-417b2ef9f3d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:37.242691 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b1d5d3a1-cb95-4e07-9ac5-417b2ef9f3d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.224497 Jun 15 10:15:37.247912 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 149/295] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:37 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:37.253962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-294d0ab6-e2df-407e-8aea-8908508718f9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:37.254833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-294d0ab6-e2df-407e-8aea-8908508718f9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:37.263539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-294d0ab6-e2df-407e-8aea-8908508718f9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:37.264099 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-294d0ab6-e2df-407e-8aea-8908508718f9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:37.265260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-294d0ab6-e2df-407e-8aea-8908508718f9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:37.265844 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-294d0ab6-e2df-407e-8aea-8908508718f9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:37.522544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-294d0ab6-e2df-407e-8aea-8908508718f9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:37.530678 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-294d0ab6-e2df-407e-8aea-8908508718f9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.281468 Jun 15 10:15:37.531261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 150/296] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:37 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:37.547357 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:15:37.547885 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:15:37.548528 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:15:37.549120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:15:37.549581 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:15:37.562639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:37.563089 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:37.563881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:37.564317 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:37.588858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Getting quotas for project 36b6b134fac8433db72a937ba72e8a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:15:37.594732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Getting quotas for user a04041aca6d64274b7019fcd6ece608c and project 36b6b134fac8433db72a937ba72e8a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:15:37.609812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:15:37.612366 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:15:37.669303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-acf4cc69-5b48-458a-858a-df0ebdce1b2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.812581 Jun 15 10:15:37.677120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 147/297] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:15:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:15:37.684053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fb4866b2-7a0a-481a-a6ce-dfa810eea66a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:37.684986 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fb4866b2-7a0a-481a-a6ce-dfa810eea66a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:37.820491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fb4866b2-7a0a-481a-a6ce-dfa810eea66a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:37.830028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fb4866b2-7a0a-481a-a6ce-dfa810eea66a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1237 microversion: 2.1 time: 0.153392 Jun 15 10:15:37.831162 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 151/298] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:37 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1237 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:38.263993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2e0a2884-67c1-4bd2-8283-7972e07cda42 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:38.264606 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2e0a2884-67c1-4bd2-8283-7972e07cda42 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:38.271323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e0a2884-67c1-4bd2-8283-7972e07cda42 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:38.271992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e0a2884-67c1-4bd2-8283-7972e07cda42 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:38.272764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e0a2884-67c1-4bd2-8283-7972e07cda42 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:38.273195 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e0a2884-67c1-4bd2-8283-7972e07cda42 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:38.464116 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-d0b14914-4050-4aa0-981a-3c8b8e554a50 req-831dd7ff-3093-48a0-b233-fe15310140b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e", "tag": "accef6ba-6969-4d7b-ada2-4cd9b23e6c8e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:38.486949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-d0b14914-4050-4aa0-981a-3c8b8e554a50 req-831dd7ff-3093-48a0-b233-fe15310140b0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:38.488020 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-d0b14914-4050-4aa0-981a-3c8b8e554a50 req-831dd7ff-3093-48a0-b233-fe15310140b0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:38.512474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2e0a2884-67c1-4bd2-8283-7972e07cda42 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:38.515728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-d0b14914-4050-4aa0-981a-3c8b8e554a50 req-831dd7ff-3093-48a0-b233-fe15310140b0 service nova] Creating event network-changed:accef6ba-6969-4d7b-ada2-4cd9b23e6c8e for instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e on hv-cinder-83028 Jun 15 10:15:38.521823 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2e0a2884-67c1-4bd2-8283-7972e07cda42 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.261308 Jun 15 10:15:38.522841 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-d0b14914-4050-4aa0-981a-3c8b8e554a50 req-831dd7ff-3093-48a0-b233-fe15310140b0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064713 Jun 15 10:15:38.523075 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 148/299] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:38 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:38.523445 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 152/300] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:38.553765 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-58d3a0ed-78b5-40e8-8028-f7f3bdafd27a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:38.554864 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-58d3a0ed-78b5-40e8-8028-f7f3bdafd27a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:38.566890 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-58d3a0ed-78b5-40e8-8028-f7f3bdafd27a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:38.567423 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-58d3a0ed-78b5-40e8-8028-f7f3bdafd27a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:38.568424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-58d3a0ed-78b5-40e8-8028-f7f3bdafd27a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:38.568866 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-58d3a0ed-78b5-40e8-8028-f7f3bdafd27a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:38.775662 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-58d3a0ed-78b5-40e8-8028-f7f3bdafd27a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:38.792111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-58d3a0ed-78b5-40e8-8028-f7f3bdafd27a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.245538 Jun 15 10:15:38.792727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 149/301] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:38 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:38.849127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d38ceb50-2671-4f52-be3b-2bfae0ab27df tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:38.849796 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d38ceb50-2671-4f52-be3b-2bfae0ab27df tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:38.850500 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-921342927", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:38.863704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d38ceb50-2671-4f52-be3b-2bfae0ab27df tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:38.864566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d38ceb50-2671-4f52-be3b-2bfae0ab27df tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:38.866152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d38ceb50-2671-4f52-be3b-2bfae0ab27df tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:38.866917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d38ceb50-2671-4f52-be3b-2bfae0ab27df tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:38.934940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] validate_networks() for None {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:15:38.969531 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d38ceb50-2671-4f52-be3b-2bfae0ab27df tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:38.981422 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d38ceb50-2671-4f52-be3b-2bfae0ab27df tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1233 microversion: 2.1 time: 0.137567 Jun 15 10:15:38.983003 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 153/302] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:38 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1233 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:39.511052 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:15:39.511565 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:15:39.511929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:15:39.512513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:15:39.512958 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:15:39.523095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:39.523538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:39.524882 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:39.525314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:39.540790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e68b9e4d-3bf3-4523-b3dd-336935ff3c4f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:39.541954 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e68b9e4d-3bf3-4523-b3dd-336935ff3c4f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:39.543342 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Getting quotas for project 2cc70ff0699f491eb277bdb64843a6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:15:39.547251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Getting quotas for user 2bba21b1248c419eb7bcc16781fe927a and project 2cc70ff0699f491eb277bdb64843a6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:15:39.549744 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e68b9e4d-3bf3-4523-b3dd-336935ff3c4f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:39.550095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e68b9e4d-3bf3-4523-b3dd-336935ff3c4f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:39.550909 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e68b9e4d-3bf3-4523-b3dd-336935ff3c4f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:39.551814 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e68b9e4d-3bf3-4523-b3dd-336935ff3c4f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:39.566398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:15:39.568762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:15:39.633442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5cb0505f-2a9d-4988-a6a6-8540b87fe249 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787127 Jun 15 10:15:39.635616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 150/303] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:15:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:15:39.646622 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c4dc818c-721a-4819-a20c-d3d5a025d2e6 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:39.647156 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c4dc818c-721a-4819-a20c-d3d5a025d2e6 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:39.736294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c4dc818c-721a-4819-a20c-d3d5a025d2e6 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:39.744898 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c4dc818c-721a-4819-a20c-d3d5a025d2e6 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1214 microversion: 2.1 time: 0.102395 Jun 15 10:15:39.745914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 151/304] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:39 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:39.757631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e68b9e4d-3bf3-4523-b3dd-336935ff3c4f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:39.767222 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e68b9e4d-3bf3-4523-b3dd-336935ff3c4f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.230243 Jun 15 10:15:39.767914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 154/305] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:39 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:39.809373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e7a7ed8b-bf36-4ff6-b8ff-4a2ea7bad4d9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:39.810041 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e7a7ed8b-bf36-4ff6-b8ff-4a2ea7bad4d9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:39.817699 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e7a7ed8b-bf36-4ff6-b8ff-4a2ea7bad4d9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:39.818156 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e7a7ed8b-bf36-4ff6-b8ff-4a2ea7bad4d9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:39.818963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e7a7ed8b-bf36-4ff6-b8ff-4a2ea7bad4d9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:39.819405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e7a7ed8b-bf36-4ff6-b8ff-4a2ea7bad4d9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:39.969732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e7a7ed8b-bf36-4ff6-b8ff-4a2ea7bad4d9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:39.978876 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e7a7ed8b-bf36-4ff6-b8ff-4a2ea7bad4d9 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.173895 Jun 15 10:15:39.980505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 152/306] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:39 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:40.003014 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d0680cc2-b82c-4e45-8294-812467fb5bff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:40.003634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d0680cc2-b82c-4e45-8294-812467fb5bff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:40.020778 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d0680cc2-b82c-4e45-8294-812467fb5bff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:40.021453 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d0680cc2-b82c-4e45-8294-812467fb5bff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:40.023890 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d0680cc2-b82c-4e45-8294-812467fb5bff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:40.025278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d0680cc2-b82c-4e45-8294-812467fb5bff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:40.116576 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d0680cc2-b82c-4e45-8294-812467fb5bff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:40.126658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d0680cc2-b82c-4e45-8294-812467fb5bff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1233 microversion: 2.1 time: 0.127707 Jun 15 10:15:40.128104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 155/307] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:39 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1233 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:40.764411 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c8c12051-a584-4059-a25e-6417c7c92a61 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:40.765113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c8c12051-a584-4059-a25e-6417c7c92a61 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:40.771911 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8c12051-a584-4059-a25e-6417c7c92a61 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:40.772396 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8c12051-a584-4059-a25e-6417c7c92a61 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:40.773237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8c12051-a584-4059-a25e-6417c7c92a61 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:40.773745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8c12051-a584-4059-a25e-6417c7c92a61 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:40.784473 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8a7c2d05-6b40-461c-b5bb-eeffdfb07fc2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:40.785404 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8a7c2d05-6b40-461c-b5bb-eeffdfb07fc2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:40.792119 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a7c2d05-6b40-461c-b5bb-eeffdfb07fc2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:40.792574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a7c2d05-6b40-461c-b5bb-eeffdfb07fc2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:40.793356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a7c2d05-6b40-461c-b5bb-eeffdfb07fc2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:40.793798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a7c2d05-6b40-461c-b5bb-eeffdfb07fc2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:40.847158 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c8c12051-a584-4059-a25e-6417c7c92a61 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:40.856236 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c8c12051-a584-4059-a25e-6417c7c92a61 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1210 microversion: 2.1 time: 0.097870 Jun 15 10:15:40.856967 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 153/308] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:40 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:40.943889 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a7c2d05-6b40-461c-b5bb-eeffdfb07fc2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:40.951900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8a7c2d05-6b40-461c-b5bb-eeffdfb07fc2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.171201 Jun 15 10:15:40.952463 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 156/309] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:40 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:40.997629 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bce854a0-9e04-40f8-bf74-911e8511bb2a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:40.998326 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bce854a0-9e04-40f8-bf74-911e8511bb2a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:41.005450 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bce854a0-9e04-40f8-bf74-911e8511bb2a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:41.005984 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bce854a0-9e04-40f8-bf74-911e8511bb2a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:41.006698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bce854a0-9e04-40f8-bf74-911e8511bb2a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:41.007140 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bce854a0-9e04-40f8-bf74-911e8511bb2a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:41.144023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-704fac43-3d0a-4a55-93bf-9fd400c3fa00 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:41.144669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-704fac43-3d0a-4a55-93bf-9fd400c3fa00 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:41.151649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-704fac43-3d0a-4a55-93bf-9fd400c3fa00 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:41.152102 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-704fac43-3d0a-4a55-93bf-9fd400c3fa00 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:41.152879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-704fac43-3d0a-4a55-93bf-9fd400c3fa00 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:41.153363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-704fac43-3d0a-4a55-93bf-9fd400c3fa00 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:41.166346 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bce854a0-9e04-40f8-bf74-911e8511bb2a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:41.174006 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bce854a0-9e04-40f8-bf74-911e8511bb2a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.180324 Jun 15 10:15:41.174831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 154/310] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:40 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:41.221093 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-704fac43-3d0a-4a55-93bf-9fd400c3fa00 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:41.229847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-704fac43-3d0a-4a55-93bf-9fd400c3fa00 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1297 microversion: 2.1 time: 0.089861 Jun 15 10:15:41.230451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 157/311] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:41 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:41.876024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cd69c725-eac0-43c1-9127-e28b08fd7481 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:41.876611 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cd69c725-eac0-43c1-9127-e28b08fd7481 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:41.882507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cd69c725-eac0-43c1-9127-e28b08fd7481 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:41.883118 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cd69c725-eac0-43c1-9127-e28b08fd7481 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:41.883905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cd69c725-eac0-43c1-9127-e28b08fd7481 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:41.884529 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cd69c725-eac0-43c1-9127-e28b08fd7481 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:41.952559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cd69c725-eac0-43c1-9127-e28b08fd7481 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:41.954929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:41.961883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cd69c725-eac0-43c1-9127-e28b08fd7481 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1266 microversion: 2.1 time: 0.089666 Jun 15 10:15:41.964013 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 155/312] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:41 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:41.971023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e25b93d7-7b53-45b1-9292-4358aa971267 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:41.971780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e25b93d7-7b53-45b1-9292-4358aa971267 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:41.978709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e25b93d7-7b53-45b1-9292-4358aa971267 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:41.979233 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e25b93d7-7b53-45b1-9292-4358aa971267 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:41.980081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e25b93d7-7b53-45b1-9292-4358aa971267 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:41.980587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e25b93d7-7b53-45b1-9292-4358aa971267 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:42.143082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e25b93d7-7b53-45b1-9292-4358aa971267 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:42.150924 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e25b93d7-7b53-45b1-9292-4358aa971267 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.183784 Jun 15 10:15:42.151496 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 158/313] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:41 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:42.192254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-66d8c9ad-533a-447d-ba9b-eadce6f17e8d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:42.192970 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-66d8c9ad-533a-447d-ba9b-eadce6f17e8d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:42.200456 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-66d8c9ad-533a-447d-ba9b-eadce6f17e8d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:42.200928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-66d8c9ad-533a-447d-ba9b-eadce6f17e8d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:42.201892 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-66d8c9ad-533a-447d-ba9b-eadce6f17e8d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:42.202504 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-66d8c9ad-533a-447d-ba9b-eadce6f17e8d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:42.252884 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6fe145fe-1dfc-4a04-a0ab-806c5135198e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:42.253533 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6fe145fe-1dfc-4a04-a0ab-806c5135198e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:42.260824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6fe145fe-1dfc-4a04-a0ab-806c5135198e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:42.261525 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6fe145fe-1dfc-4a04-a0ab-806c5135198e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:42.262476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6fe145fe-1dfc-4a04-a0ab-806c5135198e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:42.263058 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6fe145fe-1dfc-4a04-a0ab-806c5135198e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:42.362739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6fe145fe-1dfc-4a04-a0ab-806c5135198e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:42.371987 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6fe145fe-1dfc-4a04-a0ab-806c5135198e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1307 microversion: 2.1 time: 0.126245 Jun 15 10:15:42.373218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 159/314] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:42 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:42.384002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-66d8c9ad-533a-447d-ba9b-eadce6f17e8d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:42.392039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-66d8c9ad-533a-447d-ba9b-eadce6f17e8d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.204385 Jun 15 10:15:42.392799 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 156/315] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:42 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:42.981133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-df5fbbf2-d519-48ea-b53f-1724d270aa5d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:42.981875 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-df5fbbf2-d519-48ea-b53f-1724d270aa5d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:42.989187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df5fbbf2-d519-48ea-b53f-1724d270aa5d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:42.989662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df5fbbf2-d519-48ea-b53f-1724d270aa5d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:42.990599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df5fbbf2-d519-48ea-b53f-1724d270aa5d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:42.991033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df5fbbf2-d519-48ea-b53f-1724d270aa5d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:43.069759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df5fbbf2-d519-48ea-b53f-1724d270aa5d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:43.077656 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-df5fbbf2-d519-48ea-b53f-1724d270aa5d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1266 microversion: 2.1 time: 0.100528 Jun 15 10:15:43.078223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 160/316] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:42 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:43.168093 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-14429692-e7bf-46de-af08-144f905ad7dd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:43.168737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-14429692-e7bf-46de-af08-144f905ad7dd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:43.175043 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-14429692-e7bf-46de-af08-144f905ad7dd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:43.175491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-14429692-e7bf-46de-af08-144f905ad7dd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:43.176261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-14429692-e7bf-46de-af08-144f905ad7dd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:43.176692 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-14429692-e7bf-46de-af08-144f905ad7dd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:43.311494 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-14429692-e7bf-46de-af08-144f905ad7dd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:43.319393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-14429692-e7bf-46de-af08-144f905ad7dd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1521 microversion: 2.1 time: 0.155254 Jun 15 10:15:43.319973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 157/317] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:43 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:43.393093 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-07264cfa-13c8-4a91-b790-d914960a7b58 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:43.393703 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-07264cfa-13c8-4a91-b790-d914960a7b58 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:43.401685 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07264cfa-13c8-4a91-b790-d914960a7b58 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:43.402117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07264cfa-13c8-4a91-b790-d914960a7b58 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:43.403790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07264cfa-13c8-4a91-b790-d914960a7b58 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:43.403790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07264cfa-13c8-4a91-b790-d914960a7b58 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:43.410441 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f0bbd877-120c-4681-89a0-96d0bea3601f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:43.410971 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f0bbd877-120c-4681-89a0-96d0bea3601f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:43.422749 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0bbd877-120c-4681-89a0-96d0bea3601f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:43.423231 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0bbd877-120c-4681-89a0-96d0bea3601f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:43.423972 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0bbd877-120c-4681-89a0-96d0bea3601f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:43.424928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0bbd877-120c-4681-89a0-96d0bea3601f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:43.507019 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07264cfa-13c8-4a91-b790-d914960a7b58 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:43.516085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-07264cfa-13c8-4a91-b790-d914960a7b58 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1307 microversion: 2.1 time: 0.128906 Jun 15 10:15:43.516885 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 161/318] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:43 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:43.581294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f0bbd877-120c-4681-89a0-96d0bea3601f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:43.588860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f0bbd877-120c-4681-89a0-96d0bea3601f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.183818 Jun 15 10:15:43.589636 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 158/319] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:43 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:44.094722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-75ebc8ea-0bb2-4643-88fb-e3fa25a2d95c tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:44.095385 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-75ebc8ea-0bb2-4643-88fb-e3fa25a2d95c tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:44.106348 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75ebc8ea-0bb2-4643-88fb-e3fa25a2d95c tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.107028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75ebc8ea-0bb2-4643-88fb-e3fa25a2d95c tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.122207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75ebc8ea-0bb2-4643-88fb-e3fa25a2d95c tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.124220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-75ebc8ea-0bb2-4643-88fb-e3fa25a2d95c tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.228180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-75ebc8ea-0bb2-4643-88fb-e3fa25a2d95c tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:44.236867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-75ebc8ea-0bb2-4643-88fb-e3fa25a2d95c tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1266 microversion: 2.1 time: 0.145745 Jun 15 10:15:44.237838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 162/320] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:44 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:44.338634 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b3c23b38-cea7-4dc7-a3c9-10cf995f4f80 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:44.339467 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b3c23b38-cea7-4dc7-a3c9-10cf995f4f80 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:44.345724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3c23b38-cea7-4dc7-a3c9-10cf995f4f80 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.346314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3c23b38-cea7-4dc7-a3c9-10cf995f4f80 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.347144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3c23b38-cea7-4dc7-a3c9-10cf995f4f80 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.347668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3c23b38-cea7-4dc7-a3c9-10cf995f4f80 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.494624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b3c23b38-cea7-4dc7-a3c9-10cf995f4f80 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:44.502838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b3c23b38-cea7-4dc7-a3c9-10cf995f4f80 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1501 microversion: 2.1 time: 0.170018 Jun 15 10:15:44.503596 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 159/321] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:44 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:44.519023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a78d6dc3-9550-4d0a-9027-19680ea5c953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:44.519654 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a78d6dc3-9550-4d0a-9027-19680ea5c953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:44.526890 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a78d6dc3-9550-4d0a-9027-19680ea5c953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.527341 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a78d6dc3-9550-4d0a-9027-19680ea5c953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.528194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a78d6dc3-9550-4d0a-9027-19680ea5c953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.528846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a78d6dc3-9550-4d0a-9027-19680ea5c953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.534378 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7cd87658-85eb-41e0-ae3b-ab58d81bc721 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:44.534378 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7cd87658-85eb-41e0-ae3b-ab58d81bc721 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:44.540354 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7cd87658-85eb-41e0-ae3b-ab58d81bc721 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.540955 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7cd87658-85eb-41e0-ae3b-ab58d81bc721 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.541739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7cd87658-85eb-41e0-ae3b-ab58d81bc721 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.542344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7cd87658-85eb-41e0-ae3b-ab58d81bc721 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.637201 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7cd87658-85eb-41e0-ae3b-ab58d81bc721 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:44.645292 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7cd87658-85eb-41e0-ae3b-ab58d81bc721 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1295 microversion: 2.1 time: 0.116274 Jun 15 10:15:44.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 160/322] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:44 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:44.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-57761ba2-a528-4809-98c0-aa8c348cce6d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:44.656491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-57761ba2-a528-4809-98c0-aa8c348cce6d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:44.660147 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-57761ba2-a528-4809-98c0-aa8c348cce6d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.660743 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-57761ba2-a528-4809-98c0-aa8c348cce6d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.661836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-57761ba2-a528-4809-98c0-aa8c348cce6d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:44.662408 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-57761ba2-a528-4809-98c0-aa8c348cce6d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:44.717087 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a78d6dc3-9550-4d0a-9027-19680ea5c953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:44.728589 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a78d6dc3-9550-4d0a-9027-19680ea5c953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1516 microversion: 2.1 time: 0.211429 Jun 15 10:15:44.741221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 163/323] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:44 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:44.819156 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-57761ba2-a528-4809-98c0-aa8c348cce6d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:44.828839 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-57761ba2-a528-4809-98c0-aa8c348cce6d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.181930 Jun 15 10:15:44.829539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 161/324] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:44 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:45.255300 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2e4ef11b-2436-4754-b31e-12a78f0a58c0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:45.256038 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2e4ef11b-2436-4754-b31e-12a78f0a58c0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:45.271997 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e4ef11b-2436-4754-b31e-12a78f0a58c0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:45.277962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e4ef11b-2436-4754-b31e-12a78f0a58c0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:45.279574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e4ef11b-2436-4754-b31e-12a78f0a58c0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:45.283049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e4ef11b-2436-4754-b31e-12a78f0a58c0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:45.363082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2e4ef11b-2436-4754-b31e-12a78f0a58c0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:45.371544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2e4ef11b-2436-4754-b31e-12a78f0a58c0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1272 microversion: 2.1 time: 0.120994 Jun 15 10:15:45.372341 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 164/325] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:45 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:45.668180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d3f5b89a-7c4f-4814-a042-8dc236769e76 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:45.669033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d3f5b89a-7c4f-4814-a042-8dc236769e76 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:45.679821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d3f5b89a-7c4f-4814-a042-8dc236769e76 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:45.681208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d3f5b89a-7c4f-4814-a042-8dc236769e76 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:45.683112 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d3f5b89a-7c4f-4814-a042-8dc236769e76 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:45.688350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d3f5b89a-7c4f-4814-a042-8dc236769e76 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:45.846693 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ce21d371-e2ee-4634-b6bc-e6261b773677 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:45.847398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ce21d371-e2ee-4634-b6bc-e6261b773677 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:45.855116 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce21d371-e2ee-4634-b6bc-e6261b773677 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:45.860908 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce21d371-e2ee-4634-b6bc-e6261b773677 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:45.863123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce21d371-e2ee-4634-b6bc-e6261b773677 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:45.866911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce21d371-e2ee-4634-b6bc-e6261b773677 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:46.177533 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d3f5b89a-7c4f-4814-a042-8dc236769e76 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:46.188745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d3f5b89a-7c4f-4814-a042-8dc236769e76 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.525480 Jun 15 10:15:46.189965 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 162/326] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:45 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:46.245311 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ce21d371-e2ee-4634-b6bc-e6261b773677 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:46.257561 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ce21d371-e2ee-4634-b6bc-e6261b773677 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.415989 Jun 15 10:15:46.272001 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 165/327] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:45 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:46.391224 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5338c622-21ad-4fb5-b64f-240002f614c1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:46.392718 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5338c622-21ad-4fb5-b64f-240002f614c1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:46.405996 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e54738b9-e89c-4b6e-8950-41a5582b174e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:46.407396 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e54738b9-e89c-4b6e-8950-41a5582b174e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:46.408493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5338c622-21ad-4fb5-b64f-240002f614c1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:46.410418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5338c622-21ad-4fb5-b64f-240002f614c1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:46.411676 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5338c622-21ad-4fb5-b64f-240002f614c1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:46.413430 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5338c622-21ad-4fb5-b64f-240002f614c1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:46.421576 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e54738b9-e89c-4b6e-8950-41a5582b174e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:46.424392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e54738b9-e89c-4b6e-8950-41a5582b174e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:46.425413 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e54738b9-e89c-4b6e-8950-41a5582b174e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:46.425868 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e54738b9-e89c-4b6e-8950-41a5582b174e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:46.490080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-e54738b9-e89c-4b6e-8950-41a5582b174e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lazy-loading 'flavor' on Instance uuid ea751c2f-c929-4939-b72c-70a5487bba0a {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:15:46.542246 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5338c622-21ad-4fb5-b64f-240002f614c1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:46.545480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:46.553056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5338c622-21ad-4fb5-b64f-240002f614c1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1272 microversion: 2.1 time: 0.165418 Jun 15 10:15:46.553667 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 163/328] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:46 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:46.693182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e54738b9-e89c-4b6e-8950-41a5582b174e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a/action" status: 200 len: 32 microversion: 2.1 time: 0.290163 Jun 15 10:15:46.694294 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 166/329] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:15:46 2022] POST /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:15:46.705617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-97b3cbca-1ee7-4726-8db5-df97fc5dd5ea tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:46.707406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-97b3cbca-1ee7-4726-8db5-df97fc5dd5ea tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:46.716769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97b3cbca-1ee7-4726-8db5-df97fc5dd5ea tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:46.719311 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97b3cbca-1ee7-4726-8db5-df97fc5dd5ea tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:46.721519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97b3cbca-1ee7-4726-8db5-df97fc5dd5ea tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:46.722159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97b3cbca-1ee7-4726-8db5-df97fc5dd5ea tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:47.078226 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-97b3cbca-1ee7-4726-8db5-df97fc5dd5ea tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:47.089452 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-97b3cbca-1ee7-4726-8db5-df97fc5dd5ea tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.387911 Jun 15 10:15:47.101631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 164/330] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:46 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:47.208226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c694bb24-0f72-46a4-9ce2-a1c7d61ab5f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:47.209160 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c694bb24-0f72-46a4-9ce2-a1c7d61ab5f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:47.227445 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c694bb24-0f72-46a4-9ce2-a1c7d61ab5f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:47.228322 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c694bb24-0f72-46a4-9ce2-a1c7d61ab5f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:47.229324 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c694bb24-0f72-46a4-9ce2-a1c7d61ab5f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:47.229933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c694bb24-0f72-46a4-9ce2-a1c7d61ab5f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:47.276783 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c29df54c-43be-458c-b3e1-0cb3c2a6fd06 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:47.277665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c29df54c-43be-458c-b3e1-0cb3c2a6fd06 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:47.292652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:47.300750 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c29df54c-43be-458c-b3e1-0cb3c2a6fd06 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:47.301493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c29df54c-43be-458c-b3e1-0cb3c2a6fd06 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:47.303860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c29df54c-43be-458c-b3e1-0cb3c2a6fd06 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:47.306538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c29df54c-43be-458c-b3e1-0cb3c2a6fd06 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:47.727955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c694bb24-0f72-46a4-9ce2-a1c7d61ab5f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:47.737612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c694bb24-0f72-46a4-9ce2-a1c7d61ab5f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.533655 Jun 15 10:15:47.741780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 167/331] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:47 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:47.749549 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c29df54c-43be-458c-b3e1-0cb3c2a6fd06 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:47.755984 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ef70d26c-08a2-45db-a743-9d3724ee4576 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:47.760853 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ef70d26c-08a2-45db-a743-9d3724ee4576 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:47.762887 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c29df54c-43be-458c-b3e1-0cb3c2a6fd06 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.489717 Jun 15 10:15:47.774950 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 165/332] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:47 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:47.785185 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef70d26c-08a2-45db-a743-9d3724ee4576 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:47.785978 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef70d26c-08a2-45db-a743-9d3724ee4576 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:47.787720 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef70d26c-08a2-45db-a743-9d3724ee4576 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:47.789659 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef70d26c-08a2-45db-a743-9d3724ee4576 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:47.837476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=8 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:47.973693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-4d46d341-0383-4b9e-993e-df8249000897 req-b133b96d-790d-48be-b9ad-4ab0a6455ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7367c589-27eb-4ff0-860e-d6a676c70441", "tag": "6cc52a64-257c-4283-a225-228e89ddcdf0"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:48.006870 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4d46d341-0383-4b9e-993e-df8249000897 req-b133b96d-790d-48be-b9ad-4ab0a6455ab5 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:48.009532 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4d46d341-0383-4b9e-993e-df8249000897 req-b133b96d-790d-48be-b9ad-4ab0a6455ab5 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:48.034253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-4d46d341-0383-4b9e-993e-df8249000897 req-b133b96d-790d-48be-b9ad-4ab0a6455ab5 service nova] Creating event network-changed:6cc52a64-257c-4283-a225-228e89ddcdf0 for instance 7367c589-27eb-4ff0-860e-d6a676c70441 on hv-cinder-83028 Jun 15 10:15:48.041783 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ef70d26c-08a2-45db-a743-9d3724ee4576 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:48.050497 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ef70d26c-08a2-45db-a743-9d3724ee4576 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.303750 Jun 15 10:15:48.057349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 168/333] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:47 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:48.068449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-4d46d341-0383-4b9e-993e-df8249000897 req-b133b96d-790d-48be-b9ad-4ab0a6455ab5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101401 Jun 15 10:15:48.076084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 166/334] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:15:48.077801 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-85a1443b-005b-48ea-9088-1f000de9b7dc req-6baa29d2-bb9e-4b95-afec-4c54f9831395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e", "name": "network-vif-plugged", "status": "completed", "tag": "accef6ba-6969-4d7b-ada2-4cd9b23e6c8e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:48.116710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-85a1443b-005b-48ea-9088-1f000de9b7dc req-6baa29d2-bb9e-4b95-afec-4c54f9831395 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:48.120521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-85a1443b-005b-48ea-9088-1f000de9b7dc req-6baa29d2-bb9e-4b95-afec-4c54f9831395 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:48.125356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-18f064cc-9aee-4175-bb7d-9f0e075e6b4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:48.126064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-18f064cc-9aee-4175-bb7d-9f0e075e6b4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:48.142981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18f064cc-9aee-4175-bb7d-9f0e075e6b4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:48.143860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18f064cc-9aee-4175-bb7d-9f0e075e6b4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:48.145268 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18f064cc-9aee-4175-bb7d-9f0e075e6b4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:48.145717 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-18f064cc-9aee-4175-bb7d-9f0e075e6b4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:48.150677 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-85a1443b-005b-48ea-9088-1f000de9b7dc req-6baa29d2-bb9e-4b95-afec-4c54f9831395 service nova] Creating event network-vif-plugged:accef6ba-6969-4d7b-ada2-4cd9b23e6c8e for instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e on hv-cinder-83028 Jun 15 10:15:48.157143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-85a1443b-005b-48ea-9088-1f000de9b7dc req-6baa29d2-bb9e-4b95-afec-4c54f9831395 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083838 Jun 15 10:15:48.160775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 169/335] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:15:48.422460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-18f064cc-9aee-4175-bb7d-9f0e075e6b4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:48.432030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-18f064cc-9aee-4175-bb7d-9f0e075e6b4c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.322553 Jun 15 10:15:48.435880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 167/336] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:48 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:48.757407 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-215d927b-bf64-4480-b9a2-52d3b89bdf8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:48.759447 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-215d927b-bf64-4480-b9a2-52d3b89bdf8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:48.769712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-215d927b-bf64-4480-b9a2-52d3b89bdf8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:48.770219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-215d927b-bf64-4480-b9a2-52d3b89bdf8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:48.771159 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-215d927b-bf64-4480-b9a2-52d3b89bdf8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:48.771674 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-215d927b-bf64-4480-b9a2-52d3b89bdf8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:48.781846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c97cb6b4-d1a7-42c6-945d-9ab1c4632b9c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:48.782643 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c97cb6b4-d1a7-42c6-945d-9ab1c4632b9c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:48.791505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c97cb6b4-d1a7-42c6-945d-9ab1c4632b9c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:48.791990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c97cb6b4-d1a7-42c6-945d-9ab1c4632b9c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:48.792798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c97cb6b4-d1a7-42c6-945d-9ab1c4632b9c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:48.793261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c97cb6b4-d1a7-42c6-945d-9ab1c4632b9c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:49.237237 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-215d927b-bf64-4480-b9a2-52d3b89bdf8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:49.246466 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-215d927b-bf64-4480-b9a2-52d3b89bdf8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.495060 Jun 15 10:15:49.247078 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 170/337] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:48 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:49.247702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c97cb6b4-d1a7-42c6-945d-9ab1c4632b9c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:49.256266 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1f36653d-9783-4832-8c7d-c672a07e97a0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:49.257135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1f36653d-9783-4832-8c7d-c672a07e97a0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:49.264193 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f36653d-9783-4832-8c7d-c672a07e97a0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:49.264653 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f36653d-9783-4832-8c7d-c672a07e97a0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:49.265652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f36653d-9783-4832-8c7d-c672a07e97a0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:49.266094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f36653d-9783-4832-8c7d-c672a07e97a0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:49.269056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c97cb6b4-d1a7-42c6-945d-9ab1c4632b9c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.492091 Jun 15 10:15:49.276861 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 168/338] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:48 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:49.452052 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d96a06cc-366b-4906-bf2c-3dba2021f65e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:49.453063 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d96a06cc-366b-4906-bf2c-3dba2021f65e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:49.460631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d96a06cc-366b-4906-bf2c-3dba2021f65e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:49.461056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d96a06cc-366b-4906-bf2c-3dba2021f65e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:49.461837 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d96a06cc-366b-4906-bf2c-3dba2021f65e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:49.462545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d96a06cc-366b-4906-bf2c-3dba2021f65e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:49.533744 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:49.535788 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1f36653d-9783-4832-8c7d-c672a07e97a0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:49.546129 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1f36653d-9783-4832-8c7d-c672a07e97a0 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.297594 Jun 15 10:15:49.546977 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 171/339] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:49 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:49.740616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=20 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:49.858943 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d96a06cc-366b-4906-bf2c-3dba2021f65e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:49.868955 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d96a06cc-366b-4906-bf2c-3dba2021f65e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.420774 Jun 15 10:15:49.869647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 169/340] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:49 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:50.108329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-dce629d0-c698-4fbc-a71f-8bf351ec8cec req-7506068b-35c3-41da-b35b-9821294e0fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485e36a3-99d7-4ddf-8a46-344dee53281b", "tag": "3c94fbe4-9b22-4ae4-bd86-4a80269c1a03"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:50.124456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-dce629d0-c698-4fbc-a71f-8bf351ec8cec req-7506068b-35c3-41da-b35b-9821294e0fcf service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.124910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-dce629d0-c698-4fbc-a71f-8bf351ec8cec req-7506068b-35c3-41da-b35b-9821294e0fcf service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:50.138432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-dce629d0-c698-4fbc-a71f-8bf351ec8cec req-7506068b-35c3-41da-b35b-9821294e0fcf service nova] Creating event network-changed:3c94fbe4-9b22-4ae4-bd86-4a80269c1a03 for instance 485e36a3-99d7-4ddf-8a46-344dee53281b on hv-cinder-83028 Jun 15 10:15:50.144354 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-dce629d0-c698-4fbc-a71f-8bf351ec8cec req-7506068b-35c3-41da-b35b-9821294e0fcf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047899 Jun 15 10:15:50.145004 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 172/341] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:50.266734 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c6e5e54b-6250-4124-a9d1-3965ea3ab0d2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:50.268270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c6e5e54b-6250-4124-a9d1-3965ea3ab0d2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:50.276420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6e5e54b-6250-4124-a9d1-3965ea3ab0d2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.276955 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6e5e54b-6250-4124-a9d1-3965ea3ab0d2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:50.277782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6e5e54b-6250-4124-a9d1-3965ea3ab0d2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.278419 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c6e5e54b-6250-4124-a9d1-3965ea3ab0d2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:50.294929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2fc357f5-64fc-4417-b188-595be0003b0e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:50.296761 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2fc357f5-64fc-4417-b188-595be0003b0e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:50.308363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fc357f5-64fc-4417-b188-595be0003b0e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.308923 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fc357f5-64fc-4417-b188-595be0003b0e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:50.309881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fc357f5-64fc-4417-b188-595be0003b0e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.310507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fc357f5-64fc-4417-b188-595be0003b0e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:50.500468 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c6e5e54b-6250-4124-a9d1-3965ea3ab0d2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:50.511078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c6e5e54b-6250-4124-a9d1-3965ea3ab0d2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.252127 Jun 15 10:15:50.513786 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 170/342] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:50 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:50.564661 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4e958ecd-ce3d-43a0-893d-0524c6d9153e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:50.565665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4e958ecd-ce3d-43a0-893d-0524c6d9153e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:50.575600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e958ecd-ce3d-43a0-893d-0524c6d9153e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.576062 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e958ecd-ce3d-43a0-893d-0524c6d9153e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:50.576851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e958ecd-ce3d-43a0-893d-0524c6d9153e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.577329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e958ecd-ce3d-43a0-893d-0524c6d9153e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:50.584019 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2fc357f5-64fc-4417-b188-595be0003b0e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:50.596069 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2fc357f5-64fc-4417-b188-595be0003b0e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1318 microversion: 2.1 time: 0.307506 Jun 15 10:15:50.597675 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 173/343] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:50 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:50.782451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4e958ecd-ce3d-43a0-893d-0524c6d9153e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:50.790790 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4e958ecd-ce3d-43a0-893d-0524c6d9153e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.231354 Jun 15 10:15:50.791773 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 171/344] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:50 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:50.887592 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f130fc69-211b-4c90-83cb-b18ca04176d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:50.889198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f130fc69-211b-4c90-83cb-b18ca04176d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:50.895739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f130fc69-211b-4c90-83cb-b18ca04176d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.896175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f130fc69-211b-4c90-83cb-b18ca04176d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:50.896938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f130fc69-211b-4c90-83cb-b18ca04176d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:50.897375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f130fc69-211b-4c90-83cb-b18ca04176d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:51.072220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f130fc69-211b-4c90-83cb-b18ca04176d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:51.088679 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f130fc69-211b-4c90-83cb-b18ca04176d1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.205744 Jun 15 10:15:51.089425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 174/345] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:50 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:51.527723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c832ff88-34a4-40d6-b0fe-015da3f33c0d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:51.528333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c832ff88-34a4-40d6-b0fe-015da3f33c0d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:51.534291 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c832ff88-34a4-40d6-b0fe-015da3f33c0d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:51.534894 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c832ff88-34a4-40d6-b0fe-015da3f33c0d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:51.535517 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c832ff88-34a4-40d6-b0fe-015da3f33c0d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:51.536060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c832ff88-34a4-40d6-b0fe-015da3f33c0d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:51.614832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d429fcc1-8858-40a2-8f4e-8be30d3407db tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:51.615204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d429fcc1-8858-40a2-8f4e-8be30d3407db tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:51.622679 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d429fcc1-8858-40a2-8f4e-8be30d3407db tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:51.623482 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d429fcc1-8858-40a2-8f4e-8be30d3407db tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:51.624342 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d429fcc1-8858-40a2-8f4e-8be30d3407db tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:51.624947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d429fcc1-8858-40a2-8f4e-8be30d3407db tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:51.687860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c832ff88-34a4-40d6-b0fe-015da3f33c0d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:51.695275 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c832ff88-34a4-40d6-b0fe-015da3f33c0d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.171269 Jun 15 10:15:51.695824 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 172/346] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:51 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:51.771949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d429fcc1-8858-40a2-8f4e-8be30d3407db tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:51.780219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d429fcc1-8858-40a2-8f4e-8be30d3407db tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1507 microversion: 2.1 time: 0.169852 Jun 15 10:15:51.780808 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 175/347] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:51 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:51.808556 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ec99801f-4d65-40e0-b389-ab4c06489cb7 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:51.809251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ec99801f-4d65-40e0-b389-ab4c06489cb7 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:51.815519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec99801f-4d65-40e0-b389-ab4c06489cb7 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:51.815962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec99801f-4d65-40e0-b389-ab4c06489cb7 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:51.816732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec99801f-4d65-40e0-b389-ab4c06489cb7 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:51.817155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec99801f-4d65-40e0-b389-ab4c06489cb7 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:51.819778 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:51.968206 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ec99801f-4d65-40e0-b389-ab4c06489cb7 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:51.975755 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ec99801f-4d65-40e0-b389-ab4c06489cb7 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.171051 Jun 15 10:15:51.976328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 173/348] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:51 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:52.107079 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-86e38f44-6086-434c-8544-b69aa713b8eb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:52.108332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-86e38f44-6086-434c-8544-b69aa713b8eb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:52.118232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86e38f44-6086-434c-8544-b69aa713b8eb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:52.118937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86e38f44-6086-434c-8544-b69aa713b8eb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:52.120462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86e38f44-6086-434c-8544-b69aa713b8eb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:52.121111 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86e38f44-6086-434c-8544-b69aa713b8eb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:52.219314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-265391135", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "networks": [{"uuid": "2d5fdd44-b4f9-4ef2-99ed-04bf847520ce"}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:52.288900 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] validate_networks() for [('2d5fdd44-b4f9-4ef2-99ed-04bf847520ce', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:15:52.299976 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-86e38f44-6086-434c-8544-b69aa713b8eb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:52.310361 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-86e38f44-6086-434c-8544-b69aa713b8eb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.208151 Jun 15 10:15:52.314354 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 176/349] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:52 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:52.687492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:15:52.688030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:15:52.688566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:15:52.689040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:15:52.689579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:15:52.701107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:52.701619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:52.702601 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:52.703097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:52.713021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d5254940-f3e9-40ea-8467-2edecdaf3322 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:52.713875 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d5254940-f3e9-40ea-8467-2edecdaf3322 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:52.720270 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5254940-f3e9-40ea-8467-2edecdaf3322 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:52.721117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5254940-f3e9-40ea-8467-2edecdaf3322 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:52.722028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5254940-f3e9-40ea-8467-2edecdaf3322 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:52.722497 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5254940-f3e9-40ea-8467-2edecdaf3322 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:52.722792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Getting quotas for project 553475cebf3147b393f2c4238699c17e. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:15:52.728689 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Getting quotas for user bb45ed9fab334d019bf31a366856735f and project 553475cebf3147b393f2c4238699c17e. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:15:52.740072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:15:52.742710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:15:52.793976 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9fb53061-2423-40eb-b1ff-423b2be9d24c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578534 Jun 15 10:15:52.798432 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 174/350] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:15:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:15:52.804604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8e73d803-c847-4af8-891a-2d71a1147777 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:52.805536 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8e73d803-c847-4af8-891a-2d71a1147777 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:52.875166 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8e73d803-c847-4af8-891a-2d71a1147777 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:52.882102 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8e73d803-c847-4af8-891a-2d71a1147777 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1213 microversion: 2.1 time: 0.081401 Jun 15 10:15:52.883423 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 175/351] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:52 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:52.942638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d5254940-f3e9-40ea-8467-2edecdaf3322 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:52.953026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d5254940-f3e9-40ea-8467-2edecdaf3322 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.244202 Jun 15 10:15:52.954331 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 177/352] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:52 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:52.993143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f1e6d3fb-7ff3-4a83-acf1-fcd44f17cb7d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:52.993807 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f1e6d3fb-7ff3-4a83-acf1-fcd44f17cb7d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:53.000209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f1e6d3fb-7ff3-4a83-acf1-fcd44f17cb7d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:53.000665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f1e6d3fb-7ff3-4a83-acf1-fcd44f17cb7d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:53.001438 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f1e6d3fb-7ff3-4a83-acf1-fcd44f17cb7d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:53.001924 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f1e6d3fb-7ff3-4a83-acf1-fcd44f17cb7d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:53.154317 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f1e6d3fb-7ff3-4a83-acf1-fcd44f17cb7d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:53.162724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f1e6d3fb-7ff3-4a83-acf1-fcd44f17cb7d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.173217 Jun 15 10:15:53.164660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 176/353] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:52 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:53.332575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b558356b-5bfd-4184-b2e8-f7310a7abc15 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:53.342756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b558356b-5bfd-4184-b2e8-f7310a7abc15 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:53.349688 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b558356b-5bfd-4184-b2e8-f7310a7abc15 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:53.350202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b558356b-5bfd-4184-b2e8-f7310a7abc15 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:53.351074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b558356b-5bfd-4184-b2e8-f7310a7abc15 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:53.351715 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b558356b-5bfd-4184-b2e8-f7310a7abc15 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:53.492274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b558356b-5bfd-4184-b2e8-f7310a7abc15 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:53.503488 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b558356b-5bfd-4184-b2e8-f7310a7abc15 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.178058 Jun 15 10:15:53.504143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 178/354] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:53 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:53.900329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9c679d51-fe81-452a-a0b1-aa3778ae5cad tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:53.900936 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9c679d51-fe81-452a-a0b1-aa3778ae5cad tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:53.906986 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c679d51-fe81-452a-a0b1-aa3778ae5cad tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:53.907435 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c679d51-fe81-452a-a0b1-aa3778ae5cad tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:53.908191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c679d51-fe81-452a-a0b1-aa3778ae5cad tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:53.908626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9c679d51-fe81-452a-a0b1-aa3778ae5cad tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:53.969515 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9c679d51-fe81-452a-a0b1-aa3778ae5cad tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:53.972040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0f17c1ae-e75a-4ed3-b339-f41cfedbee7e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:53.972659 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0f17c1ae-e75a-4ed3-b339-f41cfedbee7e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:53.976988 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9c679d51-fe81-452a-a0b1-aa3778ae5cad tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1265 microversion: 2.1 time: 0.080625 Jun 15 10:15:53.977657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 177/355] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:53 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:53.979881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f17c1ae-e75a-4ed3-b339-f41cfedbee7e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:53.980334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f17c1ae-e75a-4ed3-b339-f41cfedbee7e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:53.981101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f17c1ae-e75a-4ed3-b339-f41cfedbee7e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:53.981538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f17c1ae-e75a-4ed3-b339-f41cfedbee7e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:54.120502 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f17c1ae-e75a-4ed3-b339-f41cfedbee7e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:54.127816 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0f17c1ae-e75a-4ed3-b339-f41cfedbee7e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.159531 Jun 15 10:15:54.128375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 179/356] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:53 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:54.182130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4241ef4b-93f5-41bd-b324-88acf66227f1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:54.182764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4241ef4b-93f5-41bd-b324-88acf66227f1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:54.188734 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4241ef4b-93f5-41bd-b324-88acf66227f1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:54.189179 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4241ef4b-93f5-41bd-b324-88acf66227f1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:54.189927 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4241ef4b-93f5-41bd-b324-88acf66227f1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:54.190460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4241ef4b-93f5-41bd-b324-88acf66227f1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:54.330510 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4241ef4b-93f5-41bd-b324-88acf66227f1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:54.340829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4241ef4b-93f5-41bd-b324-88acf66227f1 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.163086 Jun 15 10:15:54.341524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 178/357] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:54 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:54.520957 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-05d58be8-961b-4704-b1c0-8105cdf21173 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:54.521494 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-05d58be8-961b-4704-b1c0-8105cdf21173 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:54.528124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-05d58be8-961b-4704-b1c0-8105cdf21173 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:54.528581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-05d58be8-961b-4704-b1c0-8105cdf21173 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:54.529391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-05d58be8-961b-4704-b1c0-8105cdf21173 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:54.529840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-05d58be8-961b-4704-b1c0-8105cdf21173 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:54.666749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-05d58be8-961b-4704-b1c0-8105cdf21173 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:54.674081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-05d58be8-961b-4704-b1c0-8105cdf21173 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.157118 Jun 15 10:15:54.674682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 180/358] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:54 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:54.994967 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f80887ec-ddf8-4e41-b392-f157bca7c855 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:54.995587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f80887ec-ddf8-4e41-b392-f157bca7c855 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:55.001654 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f80887ec-ddf8-4e41-b392-f157bca7c855 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.002105 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f80887ec-ddf8-4e41-b392-f157bca7c855 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.002896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f80887ec-ddf8-4e41-b392-f157bca7c855 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.003336 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f80887ec-ddf8-4e41-b392-f157bca7c855 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.064468 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f80887ec-ddf8-4e41-b392-f157bca7c855 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:55.072266 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f80887ec-ddf8-4e41-b392-f157bca7c855 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1265 microversion: 2.1 time: 0.081616 Jun 15 10:15:55.072825 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 179/359] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:54 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:55.145248 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-356a64ec-d5d6-46b2-b247-3fb920de2b5a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:55.145891 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-356a64ec-d5d6-46b2-b247-3fb920de2b5a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:55.154040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-356a64ec-d5d6-46b2-b247-3fb920de2b5a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.154589 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-356a64ec-d5d6-46b2-b247-3fb920de2b5a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.155335 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-356a64ec-d5d6-46b2-b247-3fb920de2b5a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.155768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-356a64ec-d5d6-46b2-b247-3fb920de2b5a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.289628 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-356a64ec-d5d6-46b2-b247-3fb920de2b5a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:55.296935 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-356a64ec-d5d6-46b2-b247-3fb920de2b5a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.155970 Jun 15 10:15:55.297489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 181/360] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:55 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:55.358227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9554efaa-6cc5-4789-b812-220c7571b4b2 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:55.358855 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9554efaa-6cc5-4789-b812-220c7571b4b2 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:55.364832 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9554efaa-6cc5-4789-b812-220c7571b4b2 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.365276 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9554efaa-6cc5-4789-b812-220c7571b4b2 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.366054 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9554efaa-6cc5-4789-b812-220c7571b4b2 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.366516 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9554efaa-6cc5-4789-b812-220c7571b4b2 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.506067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9554efaa-6cc5-4789-b812-220c7571b4b2 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:55.514090 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9554efaa-6cc5-4789-b812-220c7571b4b2 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.159914 Jun 15 10:15:55.514685 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 180/361] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:55 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:55.691201 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4acca3c4-f7ea-4c8c-855c-908ac72ea71d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:55.691866 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4acca3c4-f7ea-4c8c-855c-908ac72ea71d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:55.698064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4acca3c4-f7ea-4c8c-855c-908ac72ea71d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.698577 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4acca3c4-f7ea-4c8c-855c-908ac72ea71d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.699358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4acca3c4-f7ea-4c8c-855c-908ac72ea71d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.699794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4acca3c4-f7ea-4c8c-855c-908ac72ea71d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.791766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-15e13a3c-e865-4062-b07f-ecdf1aa656c9 req-7aee817f-997e-4167-a46b-0830e6393f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7367c589-27eb-4ff0-860e-d6a676c70441", "name": "network-vif-plugged", "status": "completed", "tag": "6cc52a64-257c-4283-a225-228e89ddcdf0"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:55.799956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-15e13a3c-e865-4062-b07f-ecdf1aa656c9 req-7aee817f-997e-4167-a46b-0830e6393f0c service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:55.800453 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-15e13a3c-e865-4062-b07f-ecdf1aa656c9 req-7aee817f-997e-4167-a46b-0830e6393f0c service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:55.812305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-15e13a3c-e865-4062-b07f-ecdf1aa656c9 req-7aee817f-997e-4167-a46b-0830e6393f0c service nova] Creating event network-vif-plugged:6cc52a64-257c-4283-a225-228e89ddcdf0 for instance 7367c589-27eb-4ff0-860e-d6a676c70441 on hv-cinder-83028 Jun 15 10:15:55.817378 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-15e13a3c-e865-4062-b07f-ecdf1aa656c9 req-7aee817f-997e-4167-a46b-0830e6393f0c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030121 Jun 15 10:15:55.817975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 181/362] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:55.855056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4acca3c4-f7ea-4c8c-855c-908ac72ea71d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:55.858052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:55.865679 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4acca3c4-f7ea-4c8c-855c-908ac72ea71d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.178259 Jun 15 10:15:55.866404 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 182/363] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:55 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:56.090088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-98463770-d508-4982-92fd-04cb582f14c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:56.090805 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-98463770-d508-4982-92fd-04cb582f14c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:56.096921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98463770-d508-4982-92fd-04cb582f14c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:56.097362 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98463770-d508-4982-92fd-04cb582f14c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:56.098123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98463770-d508-4982-92fd-04cb582f14c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:56.098577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-98463770-d508-4982-92fd-04cb582f14c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:56.161104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-98463770-d508-4982-92fd-04cb582f14c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:56.169179 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-98463770-d508-4982-92fd-04cb582f14c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1265 microversion: 2.1 time: 0.084012 Jun 15 10:15:56.169738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 182/364] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:56 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:56.314886 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-19d89498-8716-457a-9d9d-a61093f4063e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:56.315520 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-19d89498-8716-457a-9d9d-a61093f4063e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:56.323478 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-19d89498-8716-457a-9d9d-a61093f4063e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:56.323921 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-19d89498-8716-457a-9d9d-a61093f4063e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:56.324681 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-19d89498-8716-457a-9d9d-a61093f4063e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:56.325110 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-19d89498-8716-457a-9d9d-a61093f4063e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:56.457621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-19d89498-8716-457a-9d9d-a61093f4063e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:56.467861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-19d89498-8716-457a-9d9d-a61093f4063e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.156301 Jun 15 10:15:56.467861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 183/365] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:56 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:56.531193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-36a72084-abaf-444d-ba91-f85788f8b7f4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:56.531809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-36a72084-abaf-444d-ba91-f85788f8b7f4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:56.538050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36a72084-abaf-444d-ba91-f85788f8b7f4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:56.538535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36a72084-abaf-444d-ba91-f85788f8b7f4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:56.539301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36a72084-abaf-444d-ba91-f85788f8b7f4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:56.539736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36a72084-abaf-444d-ba91-f85788f8b7f4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:56.674866 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-36a72084-abaf-444d-ba91-f85788f8b7f4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:56.682892 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-36a72084-abaf-444d-ba91-f85788f8b7f4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.155547 Jun 15 10:15:56.683461 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 183/366] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:56 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:56.882885 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a0e021cc-1b4c-4d3c-ac07-c2ad4562b9d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:56.884199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a0e021cc-1b4c-4d3c-ac07-c2ad4562b9d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:56.886131 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:56.891500 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0e021cc-1b4c-4d3c-ac07-c2ad4562b9d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:56.891949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0e021cc-1b4c-4d3c-ac07-c2ad4562b9d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:56.892706 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0e021cc-1b4c-4d3c-ac07-c2ad4562b9d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:56.893145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0e021cc-1b4c-4d3c-ac07-c2ad4562b9d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:57.067467 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a0e021cc-1b4c-4d3c-ac07-c2ad4562b9d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:57.076526 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a0e021cc-1b4c-4d3c-ac07-c2ad4562b9d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.197363 Jun 15 10:15:57.086358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 184/367] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:56 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:57.185649 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8aef801a-220c-4bbf-acde-e5f91ed06678 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:57.186331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8aef801a-220c-4bbf-acde-e5f91ed06678 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:57.193629 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8aef801a-220c-4bbf-acde-e5f91ed06678 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:57.194086 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8aef801a-220c-4bbf-acde-e5f91ed06678 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:57.195169 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8aef801a-220c-4bbf-acde-e5f91ed06678 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:57.195609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8aef801a-220c-4bbf-acde-e5f91ed06678 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:57.297511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8aef801a-220c-4bbf-acde-e5f91ed06678 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:57.309189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8aef801a-220c-4bbf-acde-e5f91ed06678 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1283 microversion: 2.1 time: 0.127170 Jun 15 10:15:57.310789 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 184/368] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:57 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1283 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:57.483818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-24de45cd-83c9-4f90-ac34-96216474bc41 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:57.484421 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-24de45cd-83c9-4f90-ac34-96216474bc41 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:57.500209 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24de45cd-83c9-4f90-ac34-96216474bc41 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:57.500657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24de45cd-83c9-4f90-ac34-96216474bc41 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:57.501434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24de45cd-83c9-4f90-ac34-96216474bc41 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:57.501877 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24de45cd-83c9-4f90-ac34-96216474bc41 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:57.700743 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-63c507dd-e6a8-4a46-a4d5-0d6b5a663963 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:57.701280 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-63c507dd-e6a8-4a46-a4d5-0d6b5a663963 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:57.707479 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-63c507dd-e6a8-4a46-a4d5-0d6b5a663963 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:57.707918 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-63c507dd-e6a8-4a46-a4d5-0d6b5a663963 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:57.708780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-63c507dd-e6a8-4a46-a4d5-0d6b5a663963 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:57.709211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-63c507dd-e6a8-4a46-a4d5-0d6b5a663963 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:57.733290 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-24de45cd-83c9-4f90-ac34-96216474bc41 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:57.754320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-24de45cd-83c9-4f90-ac34-96216474bc41 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.274454 Jun 15 10:15:57.757828 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 185/369] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:57 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:57.968570 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-63c507dd-e6a8-4a46-a4d5-0d6b5a663963 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:57.976030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-63c507dd-e6a8-4a46-a4d5-0d6b5a663963 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.279948 Jun 15 10:15:57.976590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 185/370] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:57 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:58.093870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ae520d17-d3c4-4e0b-8836-69d5eea0653f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:58.094494 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ae520d17-d3c4-4e0b-8836-69d5eea0653f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:58.105285 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae520d17-d3c4-4e0b-8836-69d5eea0653f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:58.105733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae520d17-d3c4-4e0b-8836-69d5eea0653f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:58.106549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae520d17-d3c4-4e0b-8836-69d5eea0653f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:58.107246 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae520d17-d3c4-4e0b-8836-69d5eea0653f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:58.252929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ae520d17-d3c4-4e0b-8836-69d5eea0653f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:58.261822 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ae520d17-d3c4-4e0b-8836-69d5eea0653f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.171824 Jun 15 10:15:58.262433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 186/371] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:58 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:58.328443 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e9e69f51-8c83-4d36-93d9-f4f563c23185 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:58.329083 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e9e69f51-8c83-4d36-93d9-f4f563c23185 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:58.335396 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e9e69f51-8c83-4d36-93d9-f4f563c23185 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:58.335853 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e9e69f51-8c83-4d36-93d9-f4f563c23185 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:58.336737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e9e69f51-8c83-4d36-93d9-f4f563c23185 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:58.337254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e9e69f51-8c83-4d36-93d9-f4f563c23185 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:58.468280 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e9e69f51-8c83-4d36-93d9-f4f563c23185 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:58.476033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e9e69f51-8c83-4d36-93d9-f4f563c23185 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.152563 Jun 15 10:15:58.476584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 186/372] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:58 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:58.775187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5a8c988d-c27c-4b01-9fbe-8b3638248b71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:58.775907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5a8c988d-c27c-4b01-9fbe-8b3638248b71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:58.782459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a8c988d-c27c-4b01-9fbe-8b3638248b71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:58.782908 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a8c988d-c27c-4b01-9fbe-8b3638248b71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:58.783684 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a8c988d-c27c-4b01-9fbe-8b3638248b71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:58.784125 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a8c988d-c27c-4b01-9fbe-8b3638248b71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:58.940074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5a8c988d-c27c-4b01-9fbe-8b3638248b71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:58.947676 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5a8c988d-c27c-4b01-9fbe-8b3638248b71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1362 microversion: 2.1 time: 0.177128 Jun 15 10:15:58.948246 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 187/373] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:58 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:58.994294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4342b0e8-0db0-4596-9528-396a19738ae4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:58.994854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4342b0e8-0db0-4596-9528-396a19738ae4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:59.000959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4342b0e8-0db0-4596-9528-396a19738ae4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.001409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4342b0e8-0db0-4596-9528-396a19738ae4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.002178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4342b0e8-0db0-4596-9528-396a19738ae4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.002641 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4342b0e8-0db0-4596-9528-396a19738ae4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.252286 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4342b0e8-0db0-4596-9528-396a19738ae4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:59.259959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4342b0e8-0db0-4596-9528-396a19738ae4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.270349 Jun 15 10:15:59.260618 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 187/374] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:58 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:59.280216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-022f17c1-6ed1-497f-ab30-998fe598a069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:59.281048 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-022f17c1-6ed1-497f-ab30-998fe598a069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:59.287319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-022f17c1-6ed1-497f-ab30-998fe598a069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.287850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-022f17c1-6ed1-497f-ab30-998fe598a069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.288804 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-022f17c1-6ed1-497f-ab30-998fe598a069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.289332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-022f17c1-6ed1-497f-ab30-998fe598a069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.493987 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3fa6f1c7-c399-42a1-92bd-3a9af04a3e02 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:59.494925 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3fa6f1c7-c399-42a1-92bd-3a9af04a3e02 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:59.501157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3fa6f1c7-c399-42a1-92bd-3a9af04a3e02 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.501387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3fa6f1c7-c399-42a1-92bd-3a9af04a3e02 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.502155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3fa6f1c7-c399-42a1-92bd-3a9af04a3e02 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.502622 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3fa6f1c7-c399-42a1-92bd-3a9af04a3e02 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.505584 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-022f17c1-6ed1-497f-ab30-998fe598a069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:59.515225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-022f17c1-6ed1-497f-ab30-998fe598a069 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.238762 Jun 15 10:15:59.516097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 188/375] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:59 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:15:59.704315 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3fa6f1c7-c399-42a1-92bd-3a9af04a3e02 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:15:59.712221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3fa6f1c7-c399-42a1-92bd-3a9af04a3e02 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.222112 Jun 15 10:15:59.712796 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 188/376] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:59 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:59.816870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-9d5398f8-a530-4164-93f0-082d535ade4a req-b0c1919c-ac69-4f71-9b16-7dda1bd4a079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e31551-e444-485f-b02f-282fe68dbd87", "tag": "1cba89bc-c133-4f59-923a-3bde100283ff"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:59.829880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-9d5398f8-a530-4164-93f0-082d535ade4a req-b0c1919c-ac69-4f71-9b16-7dda1bd4a079 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.830354 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-9d5398f8-a530-4164-93f0-082d535ade4a req-b0c1919c-ac69-4f71-9b16-7dda1bd4a079 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.844622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-9d5398f8-a530-4164-93f0-082d535ade4a req-b0c1919c-ac69-4f71-9b16-7dda1bd4a079 service nova] Creating event network-changed:1cba89bc-c133-4f59-923a-3bde100283ff for instance c5e31551-e444-485f-b02f-282fe68dbd87 on hv-cinder-83028 Jun 15 10:15:59.849489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-9d5398f8-a530-4164-93f0-082d535ade4a req-b0c1919c-ac69-4f71-9b16-7dda1bd4a079 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038714 Jun 15 10:15:59.850223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 189/377] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:59.964895 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34366b30-c841-4083-9ebb-16dcb89a84e5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:59.965522 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34366b30-c841-4083-9ebb-16dcb89a84e5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:15:59.971524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34366b30-c841-4083-9ebb-16dcb89a84e5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.971975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34366b30-c841-4083-9ebb-16dcb89a84e5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.972745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34366b30-c841-4083-9ebb-16dcb89a84e5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.973232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34366b30-c841-4083-9ebb-16dcb89a84e5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:15:59.988192 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-edc5b884-9a22-4997-ba3e-c634cfd28d4c req-6ac98c95-557f-4d90-b06c-d580fbc1a1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485e36a3-99d7-4ddf-8a46-344dee53281b", "name": "network-vif-plugged", "status": "completed", "tag": "3c94fbe4-9b22-4ae4-bd86-4a80269c1a03"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:59.998516 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-edc5b884-9a22-4997-ba3e-c634cfd28d4c req-6ac98c95-557f-4d90-b06c-d580fbc1a1a5 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:15:59.998989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-edc5b884-9a22-4997-ba3e-c634cfd28d4c req-6ac98c95-557f-4d90-b06c-d580fbc1a1a5 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.010833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-edc5b884-9a22-4997-ba3e-c634cfd28d4c req-6ac98c95-557f-4d90-b06c-d580fbc1a1a5 service nova] Creating event network-vif-plugged:3c94fbe4-9b22-4ae4-bd86-4a80269c1a03 for instance 485e36a3-99d7-4ddf-8a46-344dee53281b on hv-cinder-83028 Jun 15 10:16:00.015720 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-edc5b884-9a22-4997-ba3e-c634cfd28d4c req-6ac98c95-557f-4d90-b06c-d580fbc1a1a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031628 Jun 15 10:16:00.016319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 190/378] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:16:00.113627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-34366b30-c841-4083-9ebb-16dcb89a84e5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:00.121975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34366b30-c841-4083-9ebb-16dcb89a84e5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1548 microversion: 2.1 time: 0.161728 Jun 15 10:16:00.122774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 189/379] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:15:59 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:00.139595 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-248ee94c-3444-4ce8-aef9-2238ed037cc4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:00.140175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-248ee94c-3444-4ce8-aef9-2238ed037cc4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:00.146506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-248ee94c-3444-4ce8-aef9-2238ed037cc4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:00.146952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-248ee94c-3444-4ce8-aef9-2238ed037cc4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.147717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-248ee94c-3444-4ce8-aef9-2238ed037cc4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:00.148156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-248ee94c-3444-4ce8-aef9-2238ed037cc4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.261506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-248ee94c-3444-4ce8-aef9-2238ed037cc4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126011 Jun 15 10:16:00.262224 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 191/380] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 10:16:00 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:00.278587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-631de2da-1f3d-4c66-88a3-5f7cd42d0ca4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:00.279445 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-631de2da-1f3d-4c66-88a3-5f7cd42d0ca4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:00.287136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-631de2da-1f3d-4c66-88a3-5f7cd42d0ca4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:00.287714 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-631de2da-1f3d-4c66-88a3-5f7cd42d0ca4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.288737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-631de2da-1f3d-4c66-88a3-5f7cd42d0ca4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:00.289295 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-631de2da-1f3d-4c66-88a3-5f7cd42d0ca4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.536449 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8b2372a2-4732-4e74-8cfa-07f05565a873 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:00.539392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8b2372a2-4732-4e74-8cfa-07f05565a873 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:00.550110 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b2372a2-4732-4e74-8cfa-07f05565a873 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:00.550808 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b2372a2-4732-4e74-8cfa-07f05565a873 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.551710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b2372a2-4732-4e74-8cfa-07f05565a873 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:00.552259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b2372a2-4732-4e74-8cfa-07f05565a873 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.751335 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-631de2da-1f3d-4c66-88a3-5f7cd42d0ca4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:00.760619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-631de2da-1f3d-4c66-88a3-5f7cd42d0ca4 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.487533 Jun 15 10:16:00.761193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 190/381] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:00 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:00.766111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-60a381b1-d661-4ba4-9f9c-ad72c48dfe13 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:00.766909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-60a381b1-d661-4ba4-9f9c-ad72c48dfe13 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:00.772795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60a381b1-d661-4ba4-9f9c-ad72c48dfe13 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:00.773243 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60a381b1-d661-4ba4-9f9c-ad72c48dfe13 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.774188 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60a381b1-d661-4ba4-9f9c-ad72c48dfe13 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:00.775009 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-60a381b1-d661-4ba4-9f9c-ad72c48dfe13 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:00.777819 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8b2372a2-4732-4e74-8cfa-07f05565a873 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:00.785933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8b2372a2-4732-4e74-8cfa-07f05565a873 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.256541 Jun 15 10:16:00.786786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 192/382] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:00 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:00.924084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-60a381b1-d661-4ba4-9f9c-ad72c48dfe13 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:00.936082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-60a381b1-d661-4ba4-9f9c-ad72c48dfe13 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.173452 Jun 15 10:16:00.937780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 191/383] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:00 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:01.299120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-b872a651-cb6d-4604-8313-bcf336631ca6 req-8eba25c4-4aa6-40de-8f7c-4e625e7adf69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7367c589-27eb-4ff0-860e-d6a676c70441", "tag": "6cc52a64-257c-4283-a225-228e89ddcdf0"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:01.308205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-b872a651-cb6d-4604-8313-bcf336631ca6 req-8eba25c4-4aa6-40de-8f7c-4e625e7adf69 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:01.308646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-b872a651-cb6d-4604-8313-bcf336631ca6 req-8eba25c4-4aa6-40de-8f7c-4e625e7adf69 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:01.319993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-b872a651-cb6d-4604-8313-bcf336631ca6 req-8eba25c4-4aa6-40de-8f7c-4e625e7adf69 service nova] Creating event network-changed:6cc52a64-257c-4283-a225-228e89ddcdf0 for instance 7367c589-27eb-4ff0-860e-d6a676c70441 on hv-cinder-83028 Jun 15 10:16:01.325440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-b872a651-cb6d-4604-8313-bcf336631ca6 req-8eba25c4-4aa6-40de-8f7c-4e625e7adf69 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030012 Jun 15 10:16:01.326026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 193/384] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:01.779187 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-977061f1-14f3-4460-9010-c47b6b2d1a7b tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:01.780444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-977061f1-14f3-4460-9010-c47b6b2d1a7b tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:01.786568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-977061f1-14f3-4460-9010-c47b6b2d1a7b tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:01.787024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-977061f1-14f3-4460-9010-c47b6b2d1a7b tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:01.787806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-977061f1-14f3-4460-9010-c47b6b2d1a7b tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:01.788329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-977061f1-14f3-4460-9010-c47b6b2d1a7b tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:01.793143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:01.805417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bbb04f42-5ada-4a85-981e-69740129dc4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:01.806632 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bbb04f42-5ada-4a85-981e-69740129dc4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:01.813659 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bbb04f42-5ada-4a85-981e-69740129dc4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:01.814436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bbb04f42-5ada-4a85-981e-69740129dc4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:01.815471 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bbb04f42-5ada-4a85-981e-69740129dc4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:01.816164 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bbb04f42-5ada-4a85-981e-69740129dc4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:02.124809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-977061f1-14f3-4460-9010-c47b6b2d1a7b tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:02.142069 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-977061f1-14f3-4460-9010-c47b6b2d1a7b tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1314 microversion: 2.1 time: 0.368122 Jun 15 10:16:02.143484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 192/385] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:01 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:02.149931 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-79437683-13a8-48ac-8030-a3c57f9f7523 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:02.151049 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-79437683-13a8-48ac-8030-a3c57f9f7523 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:02.162600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bbb04f42-5ada-4a85-981e-69740129dc4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:02.173916 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bbb04f42-5ada-4a85-981e-69740129dc4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.372749 Jun 15 10:16:02.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 194/386] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:01 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:02.177590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79437683-13a8-48ac-8030-a3c57f9f7523 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:02.178213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79437683-13a8-48ac-8030-a3c57f9f7523 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:02.179174 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79437683-13a8-48ac-8030-a3c57f9f7523 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:02.179781 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79437683-13a8-48ac-8030-a3c57f9f7523 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:02.357149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-79437683-13a8-48ac-8030-a3c57f9f7523 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:02.365074 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-79437683-13a8-48ac-8030-a3c57f9f7523 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.220130 Jun 15 10:16:02.365665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 193/387] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:02 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:03.161395 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-de50a509-46bf-43b5-a715-6df1bb649b8e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:03.162090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-de50a509-46bf-43b5-a715-6df1bb649b8e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:03.168931 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-de50a509-46bf-43b5-a715-6df1bb649b8e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.169389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-de50a509-46bf-43b5-a715-6df1bb649b8e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.170163 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-de50a509-46bf-43b5-a715-6df1bb649b8e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.170668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-de50a509-46bf-43b5-a715-6df1bb649b8e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.190940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ecf015ba-c4ec-4e98-b39b-d45b36a874b7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:03.191642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ecf015ba-c4ec-4e98-b39b-d45b36a874b7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:03.194424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:03.195296 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=8 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:03.201202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ecf015ba-c4ec-4e98-b39b-d45b36a874b7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.201853 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ecf015ba-c4ec-4e98-b39b-d45b36a874b7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.202915 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ecf015ba-c4ec-4e98-b39b-d45b36a874b7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.203545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ecf015ba-c4ec-4e98-b39b-d45b36a874b7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.447626 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-de50a509-46bf-43b5-a715-6df1bb649b8e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:03.455393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-de50a509-46bf-43b5-a715-6df1bb649b8e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1463 microversion: 2.1 time: 0.298236 Jun 15 10:16:03.455964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 195/388] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:03 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1463 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:03.458756 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ecf015ba-c4ec-4e98-b39b-d45b36a874b7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:03.460416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d116d6dc-4d07-45aa-b3df-05e8e10f024d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:03.461022 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d116d6dc-4d07-45aa-b3df-05e8e10f024d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:03.467537 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ecf015ba-c4ec-4e98-b39b-d45b36a874b7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.280224 Jun 15 10:16:03.468278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 194/389] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:03 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:03.474393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d116d6dc-4d07-45aa-b3df-05e8e10f024d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.474859 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d116d6dc-4d07-45aa-b3df-05e8e10f024d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.475647 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d116d6dc-4d07-45aa-b3df-05e8e10f024d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.476086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d116d6dc-4d07-45aa-b3df-05e8e10f024d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.500058 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f9c54992-4142-4362-b5ee-e46749a9bc4e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:03.500646 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f9c54992-4142-4362-b5ee-e46749a9bc4e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:03.506602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9c54992-4142-4362-b5ee-e46749a9bc4e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.507059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9c54992-4142-4362-b5ee-e46749a9bc4e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.507913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9c54992-4142-4362-b5ee-e46749a9bc4e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.508896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9c54992-4142-4362-b5ee-e46749a9bc4e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.534635 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f9c54992-4142-4362-b5ee-e46749a9bc4e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:16:03.614136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f9c54992-4142-4362-b5ee-e46749a9bc4e tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "DELETE /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 204 len: 0 microversion: 2.1 time: 0.117597 Jun 15 10:16:03.614863 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 195/390] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:16:03 2022] DELETE /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:16:03.617111 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d116d6dc-4d07-45aa-b3df-05e8e10f024d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:03.624487 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c4e84ff3-d388-49b4-b16d-44a5378c8369 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:03.625207 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c4e84ff3-d388-49b4-b16d-44a5378c8369 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:03.628009 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d116d6dc-4d07-45aa-b3df-05e8e10f024d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.171046 Jun 15 10:16:03.628770 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 196/391] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:03 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:03.631489 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4e84ff3-d388-49b4-b16d-44a5378c8369 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.631943 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4e84ff3-d388-49b4-b16d-44a5378c8369 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.632713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4e84ff3-d388-49b4-b16d-44a5378c8369 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:03.633733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4e84ff3-d388-49b4-b16d-44a5378c8369 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:03.769397 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c4e84ff3-d388-49b4-b16d-44a5378c8369 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:03.780083 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c4e84ff3-d388-49b4-b16d-44a5378c8369 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1469 microversion: 2.1 time: 0.159594 Jun 15 10:16:03.780887 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 196/392] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:03 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:04.486392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2214a200-0901-49a5-ab11-94965ded5f9a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:04.487065 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2214a200-0901-49a5-ab11-94965ded5f9a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:04.494704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2214a200-0901-49a5-ab11-94965ded5f9a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:04.495152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2214a200-0901-49a5-ab11-94965ded5f9a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:04.496225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2214a200-0901-49a5-ab11-94965ded5f9a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:04.496676 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2214a200-0901-49a5-ab11-94965ded5f9a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:04.636487 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2214a200-0901-49a5-ab11-94965ded5f9a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:04.643960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2214a200-0901-49a5-ab11-94965ded5f9a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.161508 Jun 15 10:16:04.644826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 197/393] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:04 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:04.645616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-30d27721-658d-495b-a3dd-8fa534d45886 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:04.646229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-30d27721-658d-495b-a3dd-8fa534d45886 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:04.652238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30d27721-658d-495b-a3dd-8fa534d45886 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:04.652688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30d27721-658d-495b-a3dd-8fa534d45886 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:04.653451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30d27721-658d-495b-a3dd-8fa534d45886 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:04.653889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-30d27721-658d-495b-a3dd-8fa534d45886 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:04.783473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-30d27721-658d-495b-a3dd-8fa534d45886 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:04.791431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-30d27721-658d-495b-a3dd-8fa534d45886 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.149659 Jun 15 10:16:04.791992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 197/394] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:04 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:04.799087 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-455cfc62-0324-4d00-91b3-27d808a8ad84 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:04.799702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-455cfc62-0324-4d00-91b3-27d808a8ad84 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:04.806292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-455cfc62-0324-4d00-91b3-27d808a8ad84 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:04.806751 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-455cfc62-0324-4d00-91b3-27d808a8ad84 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:04.807522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-455cfc62-0324-4d00-91b3-27d808a8ad84 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:04.807958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-455cfc62-0324-4d00-91b3-27d808a8ad84 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:04.945593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-455cfc62-0324-4d00-91b3-27d808a8ad84 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:04.954529 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-455cfc62-0324-4d00-91b3-27d808a8ad84 tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1469 microversion: 2.1 time: 0.159168 Jun 15 10:16:04.955290 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 198/395] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:04 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:05.660896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-899e9fdd-9e75-41c3-9b31-29a9e02cbb58 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:05.661513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-899e9fdd-9e75-41c3-9b31-29a9e02cbb58 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:05.669214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-899e9fdd-9e75-41c3-9b31-29a9e02cbb58 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:05.670053 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-899e9fdd-9e75-41c3-9b31-29a9e02cbb58 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:05.671245 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-899e9fdd-9e75-41c3-9b31-29a9e02cbb58 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:05.672034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-899e9fdd-9e75-41c3-9b31-29a9e02cbb58 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:05.808313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2e37cdd1-ac56-4ed2-a94d-235bbc9902c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:05.808933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2e37cdd1-ac56-4ed2-a94d-235bbc9902c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:05.815451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e37cdd1-ac56-4ed2-a94d-235bbc9902c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:05.815898 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e37cdd1-ac56-4ed2-a94d-235bbc9902c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:05.816662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e37cdd1-ac56-4ed2-a94d-235bbc9902c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:05.817094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e37cdd1-ac56-4ed2-a94d-235bbc9902c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:05.940846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-899e9fdd-9e75-41c3-9b31-29a9e02cbb58 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:05.949871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-899e9fdd-9e75-41c3-9b31-29a9e02cbb58 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.292625 Jun 15 10:16:05.951156 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 198/396] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:05 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:05.974863 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a18cdf4e-0811-4ff7-8109-08915743211d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:05.975557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a18cdf4e-0811-4ff7-8109-08915743211d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:05.987207 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a18cdf4e-0811-4ff7-8109-08915743211d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:05.987654 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a18cdf4e-0811-4ff7-8109-08915743211d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:05.988501 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a18cdf4e-0811-4ff7-8109-08915743211d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:05.988962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a18cdf4e-0811-4ff7-8109-08915743211d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:06.123322 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2e37cdd1-ac56-4ed2-a94d-235bbc9902c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:06.132692 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2e37cdd1-ac56-4ed2-a94d-235bbc9902c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.328314 Jun 15 10:16:06.133993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 199/397] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:05 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:06.252829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a18cdf4e-0811-4ff7-8109-08915743211d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bba21b1248c419eb7bcc16781fe927a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc70ff0699f491eb277bdb64843a6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:06.260607 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a18cdf4e-0811-4ff7-8109-08915743211d tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 200 len: 1469 microversion: 2.1 time: 0.291384 Jun 15 10:16:06.261173 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 199/398] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:05 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:06.433158 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-cb1994f2-271e-486b-b1e5-81bb67419773 req-e71ef419-c70f-47a4-adf2-7d52fec8e3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485e36a3-99d7-4ddf-8a46-344dee53281b", "name": "network-vif-deleted", "tag": "3c94fbe4-9b22-4ae4-bd86-4a80269c1a03"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:06.443200 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-cb1994f2-271e-486b-b1e5-81bb67419773 req-e71ef419-c70f-47a4-adf2-7d52fec8e3b7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:06.443817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-cb1994f2-271e-486b-b1e5-81bb67419773 req-e71ef419-c70f-47a4-adf2-7d52fec8e3b7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:06.455966 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-cb1994f2-271e-486b-b1e5-81bb67419773 req-e71ef419-c70f-47a4-adf2-7d52fec8e3b7 service nova] Creating event network-vif-deleted:3c94fbe4-9b22-4ae4-bd86-4a80269c1a03 for instance 485e36a3-99d7-4ddf-8a46-344dee53281b on hv-cinder-83028 Jun 15 10:16:06.460794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-cb1994f2-271e-486b-b1e5-81bb67419773 req-e71ef419-c70f-47a4-adf2-7d52fec8e3b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Jun 15 10:16:06.462646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 200/399] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:06.968029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b1ba098e-87fb-4ca9-95ef-c38392f68250 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:06.968653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b1ba098e-87fb-4ca9-95ef-c38392f68250 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:06.975347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1ba098e-87fb-4ca9-95ef-c38392f68250 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:06.975812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1ba098e-87fb-4ca9-95ef-c38392f68250 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:06.976593 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1ba098e-87fb-4ca9-95ef-c38392f68250 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:06.977046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b1ba098e-87fb-4ca9-95ef-c38392f68250 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:07.141120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b1ba098e-87fb-4ca9-95ef-c38392f68250 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:07.151072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b1ba098e-87fb-4ca9-95ef-c38392f68250 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.187022 Jun 15 10:16:07.151653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 200/400] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:06 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:07.155120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6c2ad5d6-b986-4018-ab70-38ff66ead7e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:07.155823 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6c2ad5d6-b986-4018-ab70-38ff66ead7e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:07.162065 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c2ad5d6-b986-4018-ab70-38ff66ead7e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:07.162558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c2ad5d6-b986-4018-ab70-38ff66ead7e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:07.163324 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c2ad5d6-b986-4018-ab70-38ff66ead7e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:07.163757 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6c2ad5d6-b986-4018-ab70-38ff66ead7e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:07.276924 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:07.277542 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] [instance: 485e36a3-99d7-4ddf-8a46-344dee53281b] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:07.283962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:07.284665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:07.285797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:07.286430 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:07.308079 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] HTTP exception thrown: Instance 485e36a3-99d7-4ddf-8a46-344dee53281b could not be found. Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Request method failure captured: Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b HTTP/1.1 Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbFIj9X405Uhh9K4s3Oop29s53-ZQC2kmeHitofP6LFuq7YjFSAdDcvQffZlcTzncWHCpmtH8ifYaelM2QW_xGimm7LGn9nGtvToJ1tcNCJpu6yJgDVLfaUAdHmrhJ3pB9PnX4xd3I6-FixAL4BKux6C-dM_KdwxejVNWos9XiL77XQ Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 2cc70ff0699f491eb277bdb64843a6e7 Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesNegativeTest-1020451426 Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:16:07.310123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2cc70ff0699f491eb277bdb64843a6e7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2cc70ff0699f491eb277bdb64843a6e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2cc70ff0699f491eb277bdb64843a6e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2cc70ff0699f491eb277bdb64843a6e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesNegativeTest-1020451426 Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 2cc70ff0699f491eb277bdb64843a6e7 Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesNegativeTest-1020451426 Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesNegativeTest-1020451426-project Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 2bba21b1248c419eb7bcc16781fe927a Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesNegativeTest-1020451426-project Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 485e36a3-99d7-4ddf-8a46-344dee53281b could not be found. Jun 15 10:16:07.311678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '485e36a3-99d7-4ddf-8a46-344dee53281b'} Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485e36a3-99d7-4ddf-8a46-344dee53281b could not be found. Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:16:07.312626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485e36a3-99d7-4ddf-8a46-344dee53281b could not be found. Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485e36a3-99d7-4ddf-8a46-344dee53281b could not be found. Jun 15 10:16:07.314076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:16:07.316033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] Returning 404 to user: Instance 485e36a3-99d7-4ddf-8a46-344dee53281b could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:16:07.317056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-47e0fed6-0d5d-4ce0-b6db-65fea64664bb tempest-VolumesNegativeTest-1020451426 tempest-VolumesNegativeTest-1020451426-project] 10.222.0.57 "GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b" status: 404 len: 111 microversion: 2.1 time: 0.044143 Jun 15 10:16:07.318097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 201/401] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:07 2022] GET /compute/v2.1/servers/485e36a3-99d7-4ddf-8a46-344dee53281b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:16:07.344391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6c2ad5d6-b986-4018-ab70-38ff66ead7e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:07.353980 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6c2ad5d6-b986-4018-ab70-38ff66ead7e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.203881 Jun 15 10:16:07.354604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 201/402] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:07 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:08.169143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c8bd5396-38a5-411d-98c5-6bbc04948967 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:08.169694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c8bd5396-38a5-411d-98c5-6bbc04948967 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:08.175921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8bd5396-38a5-411d-98c5-6bbc04948967 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:08.176387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8bd5396-38a5-411d-98c5-6bbc04948967 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:08.177387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8bd5396-38a5-411d-98c5-6bbc04948967 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:08.178221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8bd5396-38a5-411d-98c5-6bbc04948967 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:08.312775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c8bd5396-38a5-411d-98c5-6bbc04948967 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:08.320105 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c8bd5396-38a5-411d-98c5-6bbc04948967 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.155667 Jun 15 10:16:08.321169 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 202/403] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:08 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:08.371109 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-227b4f7c-a50d-478e-abc8-a0622743853c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:08.371736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-227b4f7c-a50d-478e-abc8-a0622743853c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:08.378384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-227b4f7c-a50d-478e-abc8-a0622743853c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:08.378842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-227b4f7c-a50d-478e-abc8-a0622743853c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:08.379614 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-227b4f7c-a50d-478e-abc8-a0622743853c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:08.380107 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-227b4f7c-a50d-478e-abc8-a0622743853c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:08.395591 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:08.514751 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-227b4f7c-a50d-478e-abc8-a0622743853c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:08.521985 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-227b4f7c-a50d-478e-abc8-a0622743853c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.155002 Jun 15 10:16:08.522569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 202/404] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:08 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:09.339840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8315a27c-37a0-4da5-b482-2e82d67108c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:09.340453 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8315a27c-37a0-4da5-b482-2e82d67108c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:09.346541 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8315a27c-37a0-4da5-b482-2e82d67108c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:09.346993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8315a27c-37a0-4da5-b482-2e82d67108c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:09.347752 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8315a27c-37a0-4da5-b482-2e82d67108c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:09.348189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8315a27c-37a0-4da5-b482-2e82d67108c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:09.489309 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8315a27c-37a0-4da5-b482-2e82d67108c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:09.497245 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8315a27c-37a0-4da5-b482-2e82d67108c5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.161363 Jun 15 10:16:09.497814 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 203/405] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:09 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:09.540064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1dfaa85e-6a67-4a14-a9d4-7f3cb0b84337 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:09.540745 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1dfaa85e-6a67-4a14-a9d4-7f3cb0b84337 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:09.548058 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dfaa85e-6a67-4a14-a9d4-7f3cb0b84337 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:09.548628 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dfaa85e-6a67-4a14-a9d4-7f3cb0b84337 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:09.549410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dfaa85e-6a67-4a14-a9d4-7f3cb0b84337 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:09.549849 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dfaa85e-6a67-4a14-a9d4-7f3cb0b84337 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:09.687314 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1dfaa85e-6a67-4a14-a9d4-7f3cb0b84337 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:09.695071 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1dfaa85e-6a67-4a14-a9d4-7f3cb0b84337 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.159654 Jun 15 10:16:09.695678 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 203/406] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:09 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:10.514536 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f554b7b9-e823-4e37-a653-909524c5f934 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:10.515155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f554b7b9-e823-4e37-a653-909524c5f934 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:10.518145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:10.522442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f554b7b9-e823-4e37-a653-909524c5f934 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:10.522905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f554b7b9-e823-4e37-a653-909524c5f934 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:10.526507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f554b7b9-e823-4e37-a653-909524c5f934 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:10.526507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f554b7b9-e823-4e37-a653-909524c5f934 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:10.671150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f554b7b9-e823-4e37-a653-909524c5f934 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:10.679078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f554b7b9-e823-4e37-a653-909524c5f934 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.168618 Jun 15 10:16:10.679785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 204/407] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:10 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:10.713199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-73d1fc01-6338-4bce-9342-f946b073f7f6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:10.713958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-73d1fc01-6338-4bce-9342-f946b073f7f6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:10.720611 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73d1fc01-6338-4bce-9342-f946b073f7f6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:10.721060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73d1fc01-6338-4bce-9342-f946b073f7f6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:10.721829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73d1fc01-6338-4bce-9342-f946b073f7f6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:10.722287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73d1fc01-6338-4bce-9342-f946b073f7f6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:10.868238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73d1fc01-6338-4bce-9342-f946b073f7f6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:10.876411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-73d1fc01-6338-4bce-9342-f946b073f7f6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.168275 Jun 15 10:16:10.877011 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 204/408] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:10 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:11.696627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-872ef193-1e7e-4264-839d-810755d98149 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:11.697255 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-872ef193-1e7e-4264-839d-810755d98149 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:11.703294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-872ef193-1e7e-4264-839d-810755d98149 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:11.703739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-872ef193-1e7e-4264-839d-810755d98149 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:11.704489 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-872ef193-1e7e-4264-839d-810755d98149 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:11.704921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-872ef193-1e7e-4264-839d-810755d98149 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:11.841015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-872ef193-1e7e-4264-839d-810755d98149 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:11.848357 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-872ef193-1e7e-4264-839d-810755d98149 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.156259 Jun 15 10:16:11.848947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 205/409] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:11 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:11.893472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-98619933-c6aa-428a-84e8-861f1f7eb22e tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:11.894118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-98619933-c6aa-428a-84e8-861f1f7eb22e tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:11.900982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-98619933-c6aa-428a-84e8-861f1f7eb22e tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:11.901382 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-98619933-c6aa-428a-84e8-861f1f7eb22e tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:11.902152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-98619933-c6aa-428a-84e8-861f1f7eb22e tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:11.902631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-98619933-c6aa-428a-84e8-861f1f7eb22e tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:12.029650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-98619933-c6aa-428a-84e8-861f1f7eb22e tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:12.036983 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-98619933-c6aa-428a-84e8-861f1f7eb22e tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.147375 Jun 15 10:16:12.037556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 205/410] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:11 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:12.866050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d4d059b3-ddf2-4996-ad13-df35303faa14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:12.866782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d4d059b3-ddf2-4996-ad13-df35303faa14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:12.872541 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d4d059b3-ddf2-4996-ad13-df35303faa14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:12.872990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d4d059b3-ddf2-4996-ad13-df35303faa14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:12.873746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d4d059b3-ddf2-4996-ad13-df35303faa14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:12.874175 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d4d059b3-ddf2-4996-ad13-df35303faa14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:13.006812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d4d059b3-ddf2-4996-ad13-df35303faa14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:13.014672 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d4d059b3-ddf2-4996-ad13-df35303faa14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.152758 Jun 15 10:16:13.015227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 206/411] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:12 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:13.054290 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f95d8255-6307-43f1-8f92-dc5c861430ba tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:13.055394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f95d8255-6307-43f1-8f92-dc5c861430ba tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:13.061796 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95d8255-6307-43f1-8f92-dc5c861430ba tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:13.062240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95d8255-6307-43f1-8f92-dc5c861430ba tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:13.063037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95d8255-6307-43f1-8f92-dc5c861430ba tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:13.063471 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f95d8255-6307-43f1-8f92-dc5c861430ba tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:13.202987 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f95d8255-6307-43f1-8f92-dc5c861430ba tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:13.210498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f95d8255-6307-43f1-8f92-dc5c861430ba tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.160093 Jun 15 10:16:13.211645 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 206/412] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:13 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:14.032797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-790d7506-38e1-43a6-860e-6585ba0bbb74 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:14.034063 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-790d7506-38e1-43a6-860e-6585ba0bbb74 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:14.041339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-790d7506-38e1-43a6-860e-6585ba0bbb74 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:14.041723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-790d7506-38e1-43a6-860e-6585ba0bbb74 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:14.042545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-790d7506-38e1-43a6-860e-6585ba0bbb74 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:14.042993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-790d7506-38e1-43a6-860e-6585ba0bbb74 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:14.206943 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-790d7506-38e1-43a6-860e-6585ba0bbb74 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:14.209415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:14.220136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-790d7506-38e1-43a6-860e-6585ba0bbb74 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.188803 Jun 15 10:16:14.220136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 207/413] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:14 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:14.233282 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eb84ee6d-a290-4105-81ee-b3fe208f69ea tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:14.234000 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eb84ee6d-a290-4105-81ee-b3fe208f69ea tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:14.240427 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eb84ee6d-a290-4105-81ee-b3fe208f69ea tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:14.240874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eb84ee6d-a290-4105-81ee-b3fe208f69ea tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:14.241635 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eb84ee6d-a290-4105-81ee-b3fe208f69ea tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:14.242525 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eb84ee6d-a290-4105-81ee-b3fe208f69ea tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:14.378131 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eb84ee6d-a290-4105-81ee-b3fe208f69ea tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:14.387082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eb84ee6d-a290-4105-81ee-b3fe208f69ea tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.157811 Jun 15 10:16:14.387741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 207/414] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:14 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:15.239406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a1788790-87fe-4f29-a633-94b56d8eeda0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:15.240894 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a1788790-87fe-4f29-a633-94b56d8eeda0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:15.251894 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1788790-87fe-4f29-a633-94b56d8eeda0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:15.252992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1788790-87fe-4f29-a633-94b56d8eeda0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:15.254137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1788790-87fe-4f29-a633-94b56d8eeda0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:15.254781 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a1788790-87fe-4f29-a633-94b56d8eeda0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:15.404763 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e4df9a06-02a6-49ff-b41a-f4880308201f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:15.405783 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e4df9a06-02a6-49ff-b41a-f4880308201f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:15.407312 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a1788790-87fe-4f29-a633-94b56d8eeda0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:15.417033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a1788790-87fe-4f29-a633-94b56d8eeda0 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.184132 Jun 15 10:16:15.418688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 208/415] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:15 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:15.426730 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e4df9a06-02a6-49ff-b41a-f4880308201f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:15.427469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e4df9a06-02a6-49ff-b41a-f4880308201f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:15.428315 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e4df9a06-02a6-49ff-b41a-f4880308201f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:15.428750 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e4df9a06-02a6-49ff-b41a-f4880308201f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:15.561293 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e4df9a06-02a6-49ff-b41a-f4880308201f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:15.568658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e4df9a06-02a6-49ff-b41a-f4880308201f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.167873 Jun 15 10:16:15.569212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 208/416] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:15 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:16.436593 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8421d894-4c0a-42e4-b590-e5bfb8e036d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:16.437221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8421d894-4c0a-42e4-b590-e5bfb8e036d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:16.445098 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8421d894-4c0a-42e4-b590-e5bfb8e036d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:16.445987 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8421d894-4c0a-42e4-b590-e5bfb8e036d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:16.447211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8421d894-4c0a-42e4-b590-e5bfb8e036d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:16.447812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8421d894-4c0a-42e4-b590-e5bfb8e036d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:16.584992 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b58309f2-6051-4592-aaea-abc1805cb964 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:16.585667 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b58309f2-6051-4592-aaea-abc1805cb964 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:16.593562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b58309f2-6051-4592-aaea-abc1805cb964 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:16.594337 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b58309f2-6051-4592-aaea-abc1805cb964 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:16.595107 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b58309f2-6051-4592-aaea-abc1805cb964 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:16.595537 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b58309f2-6051-4592-aaea-abc1805cb964 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:17.016063 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8421d894-4c0a-42e4-b590-e5bfb8e036d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:17.025537 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8421d894-4c0a-42e4-b590-e5bfb8e036d3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.593917 Jun 15 10:16:17.026889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 209/417] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:16 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:17.055032 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b58309f2-6051-4592-aaea-abc1805cb964 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:17.064386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b58309f2-6051-4592-aaea-abc1805cb964 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.483207 Jun 15 10:16:17.065068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 209/418] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:16 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:17.165188 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-9740e4ad-fc3b-4296-84ea-001276753646 req-1ec37876-1f8f-4906-8ec2-e0206005d9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e31551-e444-485f-b02f-282fe68dbd87", "name": "network-vif-plugged", "status": "completed", "tag": "1cba89bc-c133-4f59-923a-3bde100283ff"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:17.177556 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-9740e4ad-fc3b-4296-84ea-001276753646 req-1ec37876-1f8f-4906-8ec2-e0206005d9ac service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:17.178015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-9740e4ad-fc3b-4296-84ea-001276753646 req-1ec37876-1f8f-4906-8ec2-e0206005d9ac service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:17.198053 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-9740e4ad-fc3b-4296-84ea-001276753646 req-1ec37876-1f8f-4906-8ec2-e0206005d9ac service nova] Creating event network-vif-plugged:1cba89bc-c133-4f59-923a-3bde100283ff for instance c5e31551-e444-485f-b02f-282fe68dbd87 on hv-cinder-83028 Jun 15 10:16:17.203538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-9740e4ad-fc3b-4296-84ea-001276753646 req-1ec37876-1f8f-4906-8ec2-e0206005d9ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045386 Jun 15 10:16:17.204840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 210/419] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:18.043359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9ad2b54-dd07-428d-9cc8-c873f9d0a381 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:18.043941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c9ad2b54-dd07-428d-9cc8-c873f9d0a381 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:18.050510 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9ad2b54-dd07-428d-9cc8-c873f9d0a381 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.051190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9ad2b54-dd07-428d-9cc8-c873f9d0a381 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.052118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9ad2b54-dd07-428d-9cc8-c873f9d0a381 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.052710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9ad2b54-dd07-428d-9cc8-c873f9d0a381 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.083294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ec062c24-b88f-4b1d-bba6-ec339fdeebcf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:18.084710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ec062c24-b88f-4b1d-bba6-ec339fdeebcf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:18.093434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec062c24-b88f-4b1d-bba6-ec339fdeebcf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.094586 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec062c24-b88f-4b1d-bba6-ec339fdeebcf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.095664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec062c24-b88f-4b1d-bba6-ec339fdeebcf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.096230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ec062c24-b88f-4b1d-bba6-ec339fdeebcf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.436068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c9ad2b54-dd07-428d-9cc8-c873f9d0a381 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:18.443962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c9ad2b54-dd07-428d-9cc8-c873f9d0a381 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1502 microversion: 2.1 time: 0.404437 Jun 15 10:16:18.444543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 210/420] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:18 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:18.464334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edd4ca23-7572-40d2-b551-1c12fd40d287"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:18.465805 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:18.473578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.474522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.475621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.476072 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.501405 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] HTTP exception thrown: Cannot 'attach_volume' instance ea751c2f-c929-4939-b72c-70a5487bba0a while it is in vm_state rescued Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Request method failure captured: Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a/os-volume_attachments HTTP/1.1 Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 74 Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDPGezxxUQhZoaRjOmjrO4GX92zTzIAGqRYvqhrgqzKMZJIzwRhp-N5Kk83Zyn3ltxZRD6XjCZa2blxpkLuR7Y-Z5PlRaz8ttddyzvl6Xybpv8K1RH3cYLJ3CwaO5vx0IuHkZqaEM8vB3PMESABts-q1r3IwamZYcHJ0pbJcMdiMqI Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:16:18.503126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea38be6c5c604346974bc9acac9628cd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: a3ee143a68b64f6f84e569b2b1823c5c Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {"volumeAttachment": {"volumeId": "edd4ca23-7572-40d2-b551-1c12fd40d287"}} Jun 15 10:16:18.504737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Cannot 'attach_volume' instance ea751c2f-c929-4939-b72c-70a5487bba0a while it is in vm_state rescued Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'server_id': 'ea751c2f-c929-4939-b72c-70a5487bba0a', 'body': {'volumeAttachment': {'volumeId': 'edd4ca23-7572-40d2-b551-1c12fd40d287'}}} Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea751c2f-c929-4939-b72c-70a5487bba0a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:16:18.505668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ea751c2f-c929-4939-b72c-70a5487bba0a while it is in vm_state rescued Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:16:18.507115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:16:18.509027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:16:18.509027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:16:18.509027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ea751c2f-c929-4939-b72c-70a5487bba0a while it is in vm_state rescued Jun 15 10:16:18.509027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:18.509299 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ec062c24-b88f-4b1d-bba6-ec339fdeebcf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:18.510576 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Returning 409 to user: Cannot 'attach_volume' instance ea751c2f-c929-4939-b72c-70a5487bba0a while it is in vm_state rescued {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:16:18.512185 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c9f7dbde-9d77-49de-99b3-96b4af4cba4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054191 Jun 15 10:16:18.513501 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 211/421] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:16:18 2022] POST /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 10:16:18.515818 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ec062c24-b88f-4b1d-bba6-ec339fdeebcf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.438420 Jun 15 10:16:18.517137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 211/422] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:18 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:18.526187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-18ec1fda-e9ae-4694-9662-ca7e3a01649d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:18.527076 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-18ec1fda-e9ae-4694-9662-ca7e3a01649d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:18.533475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18ec1fda-e9ae-4694-9662-ca7e3a01649d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.533951 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18ec1fda-e9ae-4694-9662-ca7e3a01649d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.534757 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18ec1fda-e9ae-4694-9662-ca7e3a01649d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.535372 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-18ec1fda-e9ae-4694-9662-ca7e3a01649d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.618505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-18ec1fda-e9ae-4694-9662-ca7e3a01649d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a/action" status: 202 len: 0 microversion: 2.1 time: 0.098490 Jun 15 10:16:18.622613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 212/423] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:16:18 2022] POST /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:16:18.627260 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5b39a37a-7603-4653-b22e-40ced67c3d65 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:18.627879 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5b39a37a-7603-4653-b22e-40ced67c3d65 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:18.636028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b39a37a-7603-4653-b22e-40ced67c3d65 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.636707 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b39a37a-7603-4653-b22e-40ced67c3d65 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.637665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b39a37a-7603-4653-b22e-40ced67c3d65 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:18.638305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b39a37a-7603-4653-b22e-40ced67c3d65 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:18.828615 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5b39a37a-7603-4653-b22e-40ced67c3d65 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:18.837281 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5b39a37a-7603-4653-b22e-40ced67c3d65 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1510 microversion: 2.1 time: 0.213843 Jun 15 10:16:18.838180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 212/424] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:18 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:19.534330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9ab1604-d313-486a-80fc-0ce8f04453b9 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:19.534965 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c9ab1604-d313-486a-80fc-0ce8f04453b9 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:19.543055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9ab1604-d313-486a-80fc-0ce8f04453b9 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:19.544490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9ab1604-d313-486a-80fc-0ce8f04453b9 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:19.545283 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9ab1604-d313-486a-80fc-0ce8f04453b9 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:19.545722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9ab1604-d313-486a-80fc-0ce8f04453b9 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:19.765738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c9ab1604-d313-486a-80fc-0ce8f04453b9 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:19.774698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c9ab1604-d313-486a-80fc-0ce8f04453b9 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1313 microversion: 2.1 time: 0.245471 Jun 15 10:16:19.783913 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 213/425] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:19 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:19.855777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d5f66941-cb2b-4c2f-bd5b-f8d4de7400bb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:19.856637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d5f66941-cb2b-4c2f-bd5b-f8d4de7400bb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:19.863750 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5f66941-cb2b-4c2f-bd5b-f8d4de7400bb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:19.864834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5f66941-cb2b-4c2f-bd5b-f8d4de7400bb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:19.866340 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5f66941-cb2b-4c2f-bd5b-f8d4de7400bb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:19.867494 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5f66941-cb2b-4c2f-bd5b-f8d4de7400bb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:20.135597 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d5f66941-cb2b-4c2f-bd5b-f8d4de7400bb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:20.143449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d5f66941-cb2b-4c2f-bd5b-f8d4de7400bb tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1510 microversion: 2.1 time: 0.291387 Jun 15 10:16:20.144344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 213/426] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:19 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:20.790403 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ba7cbdd9-9c97-44db-ac43-f4c79b2c5a82 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:20.791024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ba7cbdd9-9c97-44db-ac43-f4c79b2c5a82 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:20.801728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba7cbdd9-9c97-44db-ac43-f4c79b2c5a82 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:20.802121 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba7cbdd9-9c97-44db-ac43-f4c79b2c5a82 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:20.802949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba7cbdd9-9c97-44db-ac43-f4c79b2c5a82 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:20.803387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ba7cbdd9-9c97-44db-ac43-f4c79b2c5a82 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:21.031388 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ba7cbdd9-9c97-44db-ac43-f4c79b2c5a82 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:21.036266 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ba7cbdd9-9c97-44db-ac43-f4c79b2c5a82 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1497 microversion: 2.1 time: 0.249632 Jun 15 10:16:21.036827 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 214/427] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:20 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:21.161851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a5889056-37c1-40af-944c-452970ddcb5e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:21.162578 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a5889056-37c1-40af-944c-452970ddcb5e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:21.170245 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a5889056-37c1-40af-944c-452970ddcb5e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:21.170737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a5889056-37c1-40af-944c-452970ddcb5e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:21.171518 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a5889056-37c1-40af-944c-452970ddcb5e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:21.171962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a5889056-37c1-40af-944c-452970ddcb5e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:21.450835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a5889056-37c1-40af-944c-452970ddcb5e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:21.464124 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a5889056-37c1-40af-944c-452970ddcb5e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1510 microversion: 2.1 time: 0.303035 Jun 15 10:16:21.467371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 214/428] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:21 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:21.745704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-92ee1525-78d5-4c7f-8970-454ffd7dddf4 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:21.746785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-92ee1525-78d5-4c7f-8970-454ffd7dddf4 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:21.753611 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92ee1525-78d5-4c7f-8970-454ffd7dddf4 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:21.754435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92ee1525-78d5-4c7f-8970-454ffd7dddf4 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:21.755760 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92ee1525-78d5-4c7f-8970-454ffd7dddf4 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:21.756670 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-92ee1525-78d5-4c7f-8970-454ffd7dddf4 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:21.792393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-92ee1525-78d5-4c7f-8970-454ffd7dddf4 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:16:21.910825 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-92ee1525-78d5-4c7f-8970-454ffd7dddf4 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 204 len: 0 microversion: 2.1 time: 0.165633 Jun 15 10:16:21.912444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 215/429] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:16:21 2022] DELETE /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:16:21.923129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-24fe1350-0c4a-41ba-a2ee-17e8fe64c675 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:21.924123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-24fe1350-0c4a-41ba-a2ee-17e8fe64c675 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:21.934480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24fe1350-0c4a-41ba-a2ee-17e8fe64c675 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:21.935235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24fe1350-0c4a-41ba-a2ee-17e8fe64c675 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:21.942343 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24fe1350-0c4a-41ba-a2ee-17e8fe64c675 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:21.943378 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24fe1350-0c4a-41ba-a2ee-17e8fe64c675 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:22.169153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24fe1350-0c4a-41ba-a2ee-17e8fe64c675 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:22.184233 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-24fe1350-0c4a-41ba-a2ee-17e8fe64c675 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1503 microversion: 2.1 time: 0.266565 Jun 15 10:16:22.185538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 215/430] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:21 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:22.488879 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bddbeb18-3f96-4ab9-847a-c14ef8857da4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:22.490080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bddbeb18-3f96-4ab9-847a-c14ef8857da4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:22.498578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bddbeb18-3f96-4ab9-847a-c14ef8857da4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:22.499240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bddbeb18-3f96-4ab9-847a-c14ef8857da4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:22.500475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bddbeb18-3f96-4ab9-847a-c14ef8857da4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:22.501119 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bddbeb18-3f96-4ab9-847a-c14ef8857da4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:22.730634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bddbeb18-3f96-4ab9-847a-c14ef8857da4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:22.735487 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:22.745687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bddbeb18-3f96-4ab9-847a-c14ef8857da4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1510 microversion: 2.1 time: 0.264087 Jun 15 10:16:22.755356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 216/431] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:22 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:23.201740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3078a0d9-3a5f-4793-a4b0-1f6e0446c704 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:23.202453 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3078a0d9-3a5f-4793-a4b0-1f6e0446c704 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:23.208947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3078a0d9-3a5f-4793-a4b0-1f6e0446c704 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:23.209689 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3078a0d9-3a5f-4793-a4b0-1f6e0446c704 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:23.210829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3078a0d9-3a5f-4793-a4b0-1f6e0446c704 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:23.211438 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3078a0d9-3a5f-4793-a4b0-1f6e0446c704 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:23.608821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3078a0d9-3a5f-4793-a4b0-1f6e0446c704 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:23.617718 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3078a0d9-3a5f-4793-a4b0-1f6e0446c704 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1503 microversion: 2.1 time: 0.419856 Jun 15 10:16:23.626314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 216/432] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:23 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1503 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:23.774882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bf8b341c-e219-4fcf-89bf-efa225632f1b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:23.776319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bf8b341c-e219-4fcf-89bf-efa225632f1b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:23.789302 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bf8b341c-e219-4fcf-89bf-efa225632f1b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:23.789925 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bf8b341c-e219-4fcf-89bf-efa225632f1b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:23.793046 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bf8b341c-e219-4fcf-89bf-efa225632f1b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:23.793511 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bf8b341c-e219-4fcf-89bf-efa225632f1b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:24.041025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-bf8b341c-e219-4fcf-89bf-efa225632f1b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:24.048789 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bf8b341c-e219-4fcf-89bf-efa225632f1b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1510 microversion: 2.1 time: 0.278008 Jun 15 10:16:24.049514 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 217/433] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:23 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:24.646887 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4219e60d-1605-48c0-befc-49cdb3eb2c4d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:24.648064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4219e60d-1605-48c0-befc-49cdb3eb2c4d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:24.654639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4219e60d-1605-48c0-befc-49cdb3eb2c4d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:24.655413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4219e60d-1605-48c0-befc-49cdb3eb2c4d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:24.656397 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4219e60d-1605-48c0-befc-49cdb3eb2c4d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:24.657502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4219e60d-1605-48c0-befc-49cdb3eb2c4d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:24.902546 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4219e60d-1605-48c0-befc-49cdb3eb2c4d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:24.923653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4219e60d-1605-48c0-befc-49cdb3eb2c4d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1503 microversion: 2.1 time: 0.289384 Jun 15 10:16:24.926702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 217/434] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:24 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:25.067454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-22a15c2b-489d-4f20-bb2d-140ca17ed58d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:25.068113 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-22a15c2b-489d-4f20-bb2d-140ca17ed58d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:25.080763 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-22a15c2b-489d-4f20-bb2d-140ca17ed58d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:25.081875 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-22a15c2b-489d-4f20-bb2d-140ca17ed58d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:25.083127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-22a15c2b-489d-4f20-bb2d-140ca17ed58d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:25.084504 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-22a15c2b-489d-4f20-bb2d-140ca17ed58d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:25.347150 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-22a15c2b-489d-4f20-bb2d-140ca17ed58d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:25.355322 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-22a15c2b-489d-4f20-bb2d-140ca17ed58d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1510 microversion: 2.1 time: 0.291814 Jun 15 10:16:25.356452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 218/435] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:25 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:25.945072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cda41641-b892-4dc3-8a95-157f4dd6ec7f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:25.945997 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cda41641-b892-4dc3-8a95-157f4dd6ec7f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:25.952446 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cda41641-b892-4dc3-8a95-157f4dd6ec7f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:25.952900 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cda41641-b892-4dc3-8a95-157f4dd6ec7f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:25.953746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cda41641-b892-4dc3-8a95-157f4dd6ec7f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:25.954180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cda41641-b892-4dc3-8a95-157f4dd6ec7f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:26.208167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cda41641-b892-4dc3-8a95-157f4dd6ec7f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:26.216284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cda41641-b892-4dc3-8a95-157f4dd6ec7f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1503 microversion: 2.1 time: 0.277728 Jun 15 10:16:26.217002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 218/436] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:25 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:26.380621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e779d445-afc1-4e92-80c3-ff59f8dd9119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:26.382400 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e779d445-afc1-4e92-80c3-ff59f8dd9119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:26.391164 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e779d445-afc1-4e92-80c3-ff59f8dd9119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:26.391739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e779d445-afc1-4e92-80c3-ff59f8dd9119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:26.392727 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e779d445-afc1-4e92-80c3-ff59f8dd9119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:26.393311 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e779d445-afc1-4e92-80c3-ff59f8dd9119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:26.642438 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e779d445-afc1-4e92-80c3-ff59f8dd9119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:26.651145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e779d445-afc1-4e92-80c3-ff59f8dd9119 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1510 microversion: 2.1 time: 0.275036 Jun 15 10:16:26.651935 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 219/437] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:26 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:26.961909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1ed13b6b-96cb-43d6-a687-0937df234d23 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Action: 'create', calling method: .version_select at 0x7fe256112940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1172135021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9/IqU7t2HD0+RO80CcFCEo0430fwFNT7mbE5rE5MckcV44A+5XpE8k3C5LQDjvXKfqPtZrX3m77gNxhlThfQ+Iu0BVI4EaaTxOGUQKlp5W4cLNoeZck/FkNy1BUm5FnA=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:26.982946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-1ed13b6b-96cb-43d6-a687-0937df234d23 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Getting quotas for project d6a712f2d9e44cc6825ee925f3f068fd. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:16:26.988540 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-1ed13b6b-96cb-43d6-a687-0937df234d23 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Getting quotas for user 211501490d314544b1d60a8b42cd0cb1 and project d6a712f2d9e44cc6825ee925f3f068fd. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:16:27.032713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1ed13b6b-96cb-43d6-a687-0937df234d23 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.309739 Jun 15 10:16:27.033432 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 219/438] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:16:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:27.233052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6f443838-e311-4bb6-9ce1-7368bf8df364 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:27.233668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6f443838-e311-4bb6-9ce1-7368bf8df364 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:27.236655 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:27.240165 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6f443838-e311-4bb6-9ce1-7368bf8df364 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:27.240618 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6f443838-e311-4bb6-9ce1-7368bf8df364 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:27.241418 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6f443838-e311-4bb6-9ce1-7368bf8df364 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:27.241851 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6f443838-e311-4bb6-9ce1-7368bf8df364 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:27.405841 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6f443838-e311-4bb6-9ce1-7368bf8df364 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:27.417229 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6f443838-e311-4bb6-9ce1-7368bf8df364 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1503 microversion: 2.1 time: 0.187973 Jun 15 10:16:27.427864 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 220/439] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:27 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:27.673576 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0722a14b-8185-4ab6-a430-87b86974a817 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:27.675888 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0722a14b-8185-4ab6-a430-87b86974a817 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:27.685223 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0722a14b-8185-4ab6-a430-87b86974a817 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:27.686178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0722a14b-8185-4ab6-a430-87b86974a817 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:27.687496 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0722a14b-8185-4ab6-a430-87b86974a817 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:27.688704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0722a14b-8185-4ab6-a430-87b86974a817 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:27.912202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0722a14b-8185-4ab6-a430-87b86974a817 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:27.927424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0722a14b-8185-4ab6-a430-87b86974a817 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1516 microversion: 2.1 time: 0.261843 Jun 15 10:16:27.930647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 220/440] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:27 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:28.046832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-ba782fc1-f10b-4ce7-ae59-a265183f33ea req-3b76f442-81c5-4f21-a3e3-482d2eb5d23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e31551-e444-485f-b02f-282fe68dbd87", "name": "network-vif-deleted", "tag": "1cba89bc-c133-4f59-923a-3bde100283ff"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:28.057481 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ba782fc1-f10b-4ce7-ae59-a265183f33ea req-3b76f442-81c5-4f21-a3e3-482d2eb5d23f service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:28.057955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ba782fc1-f10b-4ce7-ae59-a265183f33ea req-3b76f442-81c5-4f21-a3e3-482d2eb5d23f service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:28.071213 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-ba782fc1-f10b-4ce7-ae59-a265183f33ea req-3b76f442-81c5-4f21-a3e3-482d2eb5d23f service nova] Creating event network-vif-deleted:1cba89bc-c133-4f59-923a-3bde100283ff for instance c5e31551-e444-485f-b02f-282fe68dbd87 on hv-cinder-83028 Jun 15 10:16:28.076504 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-ba782fc1-f10b-4ce7-ae59-a265183f33ea req-3b76f442-81c5-4f21-a3e3-482d2eb5d23f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033285 Jun 15 10:16:28.077108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 221/441] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:28.434933 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:28.436084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:28.444308 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:28.444967 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:28.446506 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:28.447323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:28.482929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:28.483638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:28.484254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lazy-loading 'fault' on Instance uuid c5e31551-e444-485f-b02f-282fe68dbd87 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:16:28.556095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:28.565984 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8f0830a3-f460-4dc0-b8c6-332b9ab30355 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 200 len: 1303 microversion: 2.1 time: 0.135355 Jun 15 10:16:28.569559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 221/442] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:28 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:29.587364 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:29.588108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: c5e31551-e444-485f-b02f-282fe68dbd87] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:29.594390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:29.594833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:29.595596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:29.596026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:29.612735 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] HTTP exception thrown: Instance c5e31551-e444-485f-b02f-282fe68dbd87 could not be found. Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Request method failure captured: Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 HTTP/1.1 Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbFW_2AQVEmaOPh25SXKyn9oL2IIBY1U0An8EgxmgS9tWlcUldirx_mPWCQlF-s21Ecgj2yYCquw4Ca__P2xW4cX9aeXcFY155DO0hyPAKpk8xpw4nFanCkrhgaICuqCS0dg3RlnMoJsWrzrF_8ST1U0L-dvAp9lNDQzwBKOJ4N6LuY Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 553475cebf3147b393f2c4238699c17e Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesActionsTest-273895664 Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:16:29.615558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_553475cebf3147b393f2c4238699c17e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/553475cebf3147b393f2c4238699c17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/553475cebf3147b393f2c4238699c17e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/553475cebf3147b393f2c4238699c17e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesActionsTest-273895664 Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 553475cebf3147b393f2c4238699c17e Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesActionsTest-273895664 Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesActionsTest-273895664-project Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: bb45ed9fab334d019bf31a366856735f Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesActionsTest-273895664-project Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance c5e31551-e444-485f-b02f-282fe68dbd87 could not be found. Jun 15 10:16:29.617444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'c5e31551-e444-485f-b02f-282fe68dbd87'} Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e31551-e444-485f-b02f-282fe68dbd87 could not be found. Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:16:29.618172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e31551-e444-485f-b02f-282fe68dbd87 could not be found. Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e31551-e444-485f-b02f-282fe68dbd87 could not be found. Jun 15 10:16:29.619468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:16:29.621696 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Returning 404 to user: Instance c5e31551-e444-485f-b02f-282fe68dbd87 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:16:29.621696 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0a4b72a2-1a56-4ce9-acaf-10cec745c445 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87" status: 404 len: 111 microversion: 2.1 time: 0.035437 Jun 15 10:16:29.621696 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 222/443] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:29 2022] GET /compute/v2.1/servers/c5e31551-e444-485f-b02f-282fe68dbd87 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:16:29.694151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e828c972-affe-474e-81ca-9f0d61dcbd58 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eeb1f905-81fd-4ae6-b36e-9317d50af4b7", "device": "/dev/sdb"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:29.696216 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e828c972-affe-474e-81ca-9f0d61dcbd58 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:29.702930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e828c972-affe-474e-81ca-9f0d61dcbd58 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:29.703461 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e828c972-affe-474e-81ca-9f0d61dcbd58 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:29.704302 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e828c972-affe-474e-81ca-9f0d61dcbd58 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:29.704893 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e828c972-affe-474e-81ca-9f0d61dcbd58 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:29.726776 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1242186854", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "networks": [{"uuid": "2d5fdd44-b4f9-4ef2-99ed-04bf847520ce"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:29.819051 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] validate_networks() for [('2d5fdd44-b4f9-4ef2-99ed-04bf847520ce', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:16:30.246968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:16:30.247399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:16:30.247890 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:16:30.248318 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:16:30.249216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:16:30.259911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:30.260583 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:30.262024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:30.262615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:30.297574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Getting quotas for project 553475cebf3147b393f2c4238699c17e. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:16:30.305960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Getting quotas for user bb45ed9fab334d019bf31a366856735f and project 553475cebf3147b393f2c4238699c17e. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:16:30.321946 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:16:30.326223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:16:30.375250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [a1b9cf92-cfc9-4119-b761-3c1ab8ef9003] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 10:16:30.427991 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e828c972-affe-474e-81ca-9f0d61dcbd58 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "POST /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737926 Jun 15 10:16:30.429315 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 222/444] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:16:29 2022] POST /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:30.434992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-141c6866-d002-4655-8e48-1064a2c6d67f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'create', calling method: .version_select at 0x7fe2561420d0>, body: {"keypair": {"name": "tempest-keypair-2116850726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq+vv2WtkeqUnN2RbjHdVniDUoLlMHWTIyFClZqOXW8nQ76hiYIF+OanT09pFn1JbhHccrIoYTrWyVOWnodKT4/Dp7TwNamhRh15EHaSIDoTbvwMObeInDYA2p4gtZ1wA=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:30.450675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-141c6866-d002-4655-8e48-1064a2c6d67f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Getting quotas for project ea38be6c5c604346974bc9acac9628cd. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:16:30.455399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-141c6866-d002-4655-8e48-1064a2c6d67f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Getting quotas for user a3ee143a68b64f6f84e569b2b1823c5c and project ea38be6c5c604346974bc9acac9628cd. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:16:30.487418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-141c6866-d002-4655-8e48-1064a2c6d67f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056119 Jun 15 10:16:30.491062 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 223/445] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:16:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:31.383880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [a1b9cf92-cfc9-4119-b761-3c1ab8ef9003] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 47116. Jun 15 10:16:31.389719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fd495274-a37c-44e9-bba1-c701f104c3d0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668023 Jun 15 10:16:31.390949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 223/446] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:16:31.401996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7d5e2917-70dc-4134-8b41-88b7c1facdae tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:31.403644 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7d5e2917-70dc-4134-8b41-88b7c1facdae tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:31.462383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7d5e2917-70dc-4134-8b41-88b7c1facdae tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:31.472437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7d5e2917-70dc-4134-8b41-88b7c1facdae tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1214 microversion: 2.1 time: 0.075461 Jun 15 10:16:31.474601 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 224/447] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:31 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:31.900301 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1471520035", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "943119de-a43a-4d84-a4ef-bf25ea5d9cf3"}], "security_groups": [{"name": "tempest-securitygroup--1115109923"}], "key_name": "tempest-keypair-2116850726", "user_data": "}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:32.007225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] validate_networks() for [('943119de-a43a-4d84-a4ef-bf25ea5d9cf3', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:16:32.395759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:16:32.396344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:16:32.396634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:16:32.397041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:16:32.397451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:16:32.406038 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:32.406476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:32.407259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:32.407693 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:32.424311 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Getting quotas for project ea38be6c5c604346974bc9acac9628cd. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:16:32.427986 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Getting quotas for user a3ee143a68b64f6f84e569b2b1823c5c and project ea38be6c5c604346974bc9acac9628cd. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:16:32.439055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:16:32.441100 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:16:32.487568 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6ddbc0b2-ae4d-4ce4-806e-299911aba10c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.592086 Jun 15 10:16:32.487568 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 224/448] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:16:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:16:32.497774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5f205166-4a12-4ee0-8be5-13e7f2138526 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:32.499348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5f205166-4a12-4ee0-8be5-13e7f2138526 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:32.501145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-510fe4db-1f3e-472a-b64b-b92740c3e79e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:32.502080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-510fe4db-1f3e-472a-b64b-b92740c3e79e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:32.508693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f205166-4a12-4ee0-8be5-13e7f2138526 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:32.510598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f205166-4a12-4ee0-8be5-13e7f2138526 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:32.511867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f205166-4a12-4ee0-8be5-13e7f2138526 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:32.512475 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5f205166-4a12-4ee0-8be5-13e7f2138526 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:32.591121 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-510fe4db-1f3e-472a-b64b-b92740c3e79e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:32.594117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5f205166-4a12-4ee0-8be5-13e7f2138526 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:32.600991 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-510fe4db-1f3e-472a-b64b-b92740c3e79e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1246 microversion: 2.1 time: 0.104787 Jun 15 10:16:32.610848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 225/449] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:32 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:32.611076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5f205166-4a12-4ee0-8be5-13e7f2138526 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1218 microversion: 2.1 time: 0.118615 Jun 15 10:16:32.611076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 225/450] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:32 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:33.618818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a6ed58c2-6241-47cb-ac06-b11abf2bc294 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:33.619481 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a6ed58c2-6241-47cb-ac06-b11abf2bc294 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:33.620686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-542d4f5d-a10c-4ed5-8551-62de705ffe8c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:33.621323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-542d4f5d-a10c-4ed5-8551-62de705ffe8c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:33.626303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6ed58c2-6241-47cb-ac06-b11abf2bc294 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:33.626751 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6ed58c2-6241-47cb-ac06-b11abf2bc294 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:33.627518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6ed58c2-6241-47cb-ac06-b11abf2bc294 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:33.627657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-542d4f5d-a10c-4ed5-8551-62de705ffe8c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:33.627960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6ed58c2-6241-47cb-ac06-b11abf2bc294 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:33.628108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-542d4f5d-a10c-4ed5-8551-62de705ffe8c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:33.628843 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-542d4f5d-a10c-4ed5-8551-62de705ffe8c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:33.629281 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-542d4f5d-a10c-4ed5-8551-62de705ffe8c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:33.644239 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:33.715628 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a6ed58c2-6241-47cb-ac06-b11abf2bc294 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:33.717292 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-542d4f5d-a10c-4ed5-8551-62de705ffe8c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:33.723031 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a6ed58c2-6241-47cb-ac06-b11abf2bc294 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1250 microversion: 2.1 time: 0.108315 Jun 15 10:16:33.723589 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 226/451] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:33 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1250 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:33.724984 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-542d4f5d-a10c-4ed5-8551-62de705ffe8c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1218 microversion: 2.1 time: 0.107898 Jun 15 10:16:33.726193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 226/452] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:33 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:34.740377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-54ad2b0b-aa32-4535-a0e8-53f0856d77e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:34.741270 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-54ad2b0b-aa32-4535-a0e8-53f0856d77e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:34.742090 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8936982e-fd18-4bbf-b03d-4ef36ba2c141 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:34.742737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8936982e-fd18-4bbf-b03d-4ef36ba2c141 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:34.749157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54ad2b0b-aa32-4535-a0e8-53f0856d77e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:34.749420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54ad2b0b-aa32-4535-a0e8-53f0856d77e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:34.749985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8936982e-fd18-4bbf-b03d-4ef36ba2c141 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:34.750259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54ad2b0b-aa32-4535-a0e8-53f0856d77e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:34.750474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8936982e-fd18-4bbf-b03d-4ef36ba2c141 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:34.750656 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54ad2b0b-aa32-4535-a0e8-53f0856d77e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:34.751234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8936982e-fd18-4bbf-b03d-4ef36ba2c141 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:34.751672 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8936982e-fd18-4bbf-b03d-4ef36ba2c141 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:34.835788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8936982e-fd18-4bbf-b03d-4ef36ba2c141 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:34.839488 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-54ad2b0b-aa32-4535-a0e8-53f0856d77e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:34.844192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8936982e-fd18-4bbf-b03d-4ef36ba2c141 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1218 microversion: 2.1 time: 0.106037 Jun 15 10:16:34.845265 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 227/453] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:34 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:34.848233 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-54ad2b0b-aa32-4535-a0e8-53f0856d77e9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1250 microversion: 2.1 time: 0.111511 Jun 15 10:16:34.850235 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 227/454] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:34 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1250 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:35.862757 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-249c7574-4414-4af3-ae0b-2cce8c31e925 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:35.863398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-249c7574-4414-4af3-ae0b-2cce8c31e925 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:35.864593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-24deb754-42f0-48d8-8df8-e98ae552ca66 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:35.865203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-24deb754-42f0-48d8-8df8-e98ae552ca66 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:35.871456 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-249c7574-4414-4af3-ae0b-2cce8c31e925 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:35.871963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-249c7574-4414-4af3-ae0b-2cce8c31e925 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:35.872774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-249c7574-4414-4af3-ae0b-2cce8c31e925 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:35.873226 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-249c7574-4414-4af3-ae0b-2cce8c31e925 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:35.873559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24deb754-42f0-48d8-8df8-e98ae552ca66 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:35.874011 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24deb754-42f0-48d8-8df8-e98ae552ca66 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:35.874818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24deb754-42f0-48d8-8df8-e98ae552ca66 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:35.875259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24deb754-42f0-48d8-8df8-e98ae552ca66 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:35.940798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-249c7574-4414-4af3-ae0b-2cce8c31e925 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:35.949282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-249c7574-4414-4af3-ae0b-2cce8c31e925 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1218 microversion: 2.1 time: 0.090778 Jun 15 10:16:35.949849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 228/455] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:35 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:35.956599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-24deb754-42f0-48d8-8df8-e98ae552ca66 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:35.964493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-24deb754-42f0-48d8-8df8-e98ae552ca66 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1250 microversion: 2.1 time: 0.103718 Jun 15 10:16:35.965050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 228/456] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:35 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1250 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:36.965464 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fc5c2c08-35f1-467b-9655-81622e8ab2cf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:36.966002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fc5c2c08-35f1-467b-9655-81622e8ab2cf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:36.972485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc5c2c08-35f1-467b-9655-81622e8ab2cf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:36.972932 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc5c2c08-35f1-467b-9655-81622e8ab2cf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:36.973689 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc5c2c08-35f1-467b-9655-81622e8ab2cf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:36.974123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc5c2c08-35f1-467b-9655-81622e8ab2cf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:36.982040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-44208de7-9f69-4006-ace2-df5e70515b62 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:36.982732 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-44208de7-9f69-4006-ace2-df5e70515b62 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:36.990804 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44208de7-9f69-4006-ace2-df5e70515b62 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:36.991311 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44208de7-9f69-4006-ace2-df5e70515b62 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:36.992098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44208de7-9f69-4006-ace2-df5e70515b62 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:36.992538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44208de7-9f69-4006-ace2-df5e70515b62 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:37.055773 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fc5c2c08-35f1-467b-9655-81622e8ab2cf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:37.063077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fc5c2c08-35f1-467b-9655-81622e8ab2cf tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1218 microversion: 2.1 time: 0.101458 Jun 15 10:16:37.063660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 229/457] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:36 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:37.075967 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-44208de7-9f69-4006-ace2-df5e70515b62 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:37.083655 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-44208de7-9f69-4006-ace2-df5e70515b62 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1250 microversion: 2.1 time: 0.106156 Jun 15 10:16:37.085253 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 229/458] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:36 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1250 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:38.080296 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-81ea17fb-5298-452f-b5e4-aad473444da1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:38.080912 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-81ea17fb-5298-452f-b5e4-aad473444da1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:38.088117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81ea17fb-5298-452f-b5e4-aad473444da1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:38.088572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81ea17fb-5298-452f-b5e4-aad473444da1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:38.089347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81ea17fb-5298-452f-b5e4-aad473444da1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:38.089789 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81ea17fb-5298-452f-b5e4-aad473444da1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:38.101707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1f1f092d-79be-4d05-9ca5-7db7a3ec8b13 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:38.102456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1f1f092d-79be-4d05-9ca5-7db7a3ec8b13 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:38.109462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f1f092d-79be-4d05-9ca5-7db7a3ec8b13 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:38.109907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f1f092d-79be-4d05-9ca5-7db7a3ec8b13 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:38.110722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f1f092d-79be-4d05-9ca5-7db7a3ec8b13 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:38.111363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1f1f092d-79be-4d05-9ca5-7db7a3ec8b13 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:38.154189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-81ea17fb-5298-452f-b5e4-aad473444da1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:38.162772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-81ea17fb-5298-452f-b5e4-aad473444da1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1266 microversion: 2.1 time: 0.085537 Jun 15 10:16:38.163671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 230/459] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:38 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:38.180804 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1f1f092d-79be-4d05-9ca5-7db7a3ec8b13 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:38.188330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1f1f092d-79be-4d05-9ca5-7db7a3ec8b13 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1298 microversion: 2.1 time: 0.091210 Jun 15 10:16:38.188896 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 230/460] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:38 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:39.179609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-05001b39-40ec-4eeb-a1b6-a7a0dfb85bbb tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:39.180324 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-05001b39-40ec-4eeb-a1b6-a7a0dfb85bbb tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:39.187426 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-05001b39-40ec-4eeb-a1b6-a7a0dfb85bbb tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:39.187989 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-05001b39-40ec-4eeb-a1b6-a7a0dfb85bbb tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:39.188936 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-05001b39-40ec-4eeb-a1b6-a7a0dfb85bbb tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:39.189363 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-05001b39-40ec-4eeb-a1b6-a7a0dfb85bbb tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:39.208538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3ba2f21d-3783-493f-93a6-0a25edc345ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:39.211212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3ba2f21d-3783-493f-93a6-0a25edc345ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:39.224364 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ba2f21d-3783-493f-93a6-0a25edc345ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:39.225106 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ba2f21d-3783-493f-93a6-0a25edc345ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:39.226884 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ba2f21d-3783-493f-93a6-0a25edc345ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:39.227840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ba2f21d-3783-493f-93a6-0a25edc345ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:39.267947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-05001b39-40ec-4eeb-a1b6-a7a0dfb85bbb tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:39.276638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-05001b39-40ec-4eeb-a1b6-a7a0dfb85bbb tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1272 microversion: 2.1 time: 0.100815 Jun 15 10:16:39.278372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 231/461] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:39 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:39.312339 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3ba2f21d-3783-493f-93a6-0a25edc345ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:39.320868 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3ba2f21d-3783-493f-93a6-0a25edc345ae tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1304 microversion: 2.1 time: 0.119065 Jun 15 10:16:39.321446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 231/462] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:39 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:40.294755 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-283ead72-a14c-4436-bd34-53d039a96d97 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:40.295344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-283ead72-a14c-4436-bd34-53d039a96d97 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:40.301909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-283ead72-a14c-4436-bd34-53d039a96d97 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:40.302390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-283ead72-a14c-4436-bd34-53d039a96d97 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:40.303687 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-283ead72-a14c-4436-bd34-53d039a96d97 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:40.304258 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-283ead72-a14c-4436-bd34-53d039a96d97 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:40.341481 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e757b8de-5dd9-4174-815d-576ef52d7332 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:40.342774 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e757b8de-5dd9-4174-815d-576ef52d7332 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:40.350554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e757b8de-5dd9-4174-815d-576ef52d7332 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:40.351023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e757b8de-5dd9-4174-815d-576ef52d7332 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:40.352272 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e757b8de-5dd9-4174-815d-576ef52d7332 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:40.353008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e757b8de-5dd9-4174-815d-576ef52d7332 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:40.434018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e757b8de-5dd9-4174-815d-576ef52d7332 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:40.442853 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e757b8de-5dd9-4174-815d-576ef52d7332 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1304 microversion: 2.1 time: 0.105885 Jun 15 10:16:40.450327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 232/463] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:40 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:40.476928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-283ead72-a14c-4436-bd34-53d039a96d97 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:40.485667 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-283ead72-a14c-4436-bd34-53d039a96d97 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.194139 Jun 15 10:16:40.486319 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 232/464] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:40 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:41.380202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-bcc7b9f7-4b14-4b79-bdb4-9bc52124dbb1 req-4f0ec230-f7b4-47ea-ac05-719f45c050b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e75928-75c5-447a-82cd-5f5ddcef696e", "tag": "26bc891a-8783-4664-86ab-a8714fbc52f6"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:41.398477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-bcc7b9f7-4b14-4b79-bdb4-9bc52124dbb1 req-4f0ec230-f7b4-47ea-ac05-719f45c050b1 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:41.399008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-bcc7b9f7-4b14-4b79-bdb4-9bc52124dbb1 req-4f0ec230-f7b4-47ea-ac05-719f45c050b1 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:41.431536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-bcc7b9f7-4b14-4b79-bdb4-9bc52124dbb1 req-4f0ec230-f7b4-47ea-ac05-719f45c050b1 service nova] Creating event network-changed:26bc891a-8783-4664-86ab-a8714fbc52f6 for instance f6e75928-75c5-447a-82cd-5f5ddcef696e on hv-cinder-83028 Jun 15 10:16:41.436568 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-bcc7b9f7-4b14-4b79-bdb4-9bc52124dbb1 req-4f0ec230-f7b4-47ea-ac05-719f45c050b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061342 Jun 15 10:16:41.437363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 233/465] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:41.460467 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2b59eb11-7828-429f-a6e1-21eaf9e8e229 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:41.461125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2b59eb11-7828-429f-a6e1-21eaf9e8e229 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:41.463498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:41.467352 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=10 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:41.470075 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2b59eb11-7828-429f-a6e1-21eaf9e8e229 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:41.470627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2b59eb11-7828-429f-a6e1-21eaf9e8e229 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:41.471505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2b59eb11-7828-429f-a6e1-21eaf9e8e229 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:41.472068 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2b59eb11-7828-429f-a6e1-21eaf9e8e229 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:41.502407 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b6995b4c-e329-4d3b-bc6d-1c85ed9b4970 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:41.503202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b6995b4c-e329-4d3b-bc6d-1c85ed9b4970 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:41.510702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6995b4c-e329-4d3b-bc6d-1c85ed9b4970 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:41.513062 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6995b4c-e329-4d3b-bc6d-1c85ed9b4970 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:41.533996 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6995b4c-e329-4d3b-bc6d-1c85ed9b4970 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:41.534861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6995b4c-e329-4d3b-bc6d-1c85ed9b4970 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:41.691447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2b59eb11-7828-429f-a6e1-21eaf9e8e229 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:41.701012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2b59eb11-7828-429f-a6e1-21eaf9e8e229 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.244493 Jun 15 10:16:41.701616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 233/466] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:41 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:41.756604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b6995b4c-e329-4d3b-bc6d-1c85ed9b4970 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:41.769414 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b6995b4c-e329-4d3b-bc6d-1c85ed9b4970 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.271269 Jun 15 10:16:41.769989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 234/467] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:41 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:42.731853 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3a680f13-59b9-41a7-98d0-343d6f25c572 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:42.732484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3a680f13-59b9-41a7-98d0-343d6f25c572 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:42.741647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a680f13-59b9-41a7-98d0-343d6f25c572 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:42.742213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a680f13-59b9-41a7-98d0-343d6f25c572 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:42.743021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a680f13-59b9-41a7-98d0-343d6f25c572 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:42.743467 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a680f13-59b9-41a7-98d0-343d6f25c572 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:42.789612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-40d74e90-cd88-419f-829d-0286b76275dc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:42.791717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-40d74e90-cd88-419f-829d-0286b76275dc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:42.794802 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=4 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:42.795718 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=14 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:42.803543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40d74e90-cd88-419f-829d-0286b76275dc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:42.804148 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40d74e90-cd88-419f-829d-0286b76275dc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:42.804923 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40d74e90-cd88-419f-829d-0286b76275dc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:42.805356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-40d74e90-cd88-419f-829d-0286b76275dc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:42.942421 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3a680f13-59b9-41a7-98d0-343d6f25c572 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:42.951645 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3a680f13-59b9-41a7-98d0-343d6f25c572 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.223798 Jun 15 10:16:42.961759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 234/468] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:42 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:42.976143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-40d74e90-cd88-419f-829d-0286b76275dc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:42.983814 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-40d74e90-cd88-419f-829d-0286b76275dc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.200035 Jun 15 10:16:42.984373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 235/469] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:42 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:43.460437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-ca06a402-73dd-4f0f-b5d2-59370ef04300 req-99d826fc-b686-4a08-ade0-d8a7bf4d33f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297abce4-955d-4411-8d84-3b14a31c5f19", "tag": "0b2590ec-78e7-4638-85b3-4f3cb8ab82ec"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:43.468448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-ca06a402-73dd-4f0f-b5d2-59370ef04300 req-99d826fc-b686-4a08-ade0-d8a7bf4d33f0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:43.468895 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-ca06a402-73dd-4f0f-b5d2-59370ef04300 req-99d826fc-b686-4a08-ade0-d8a7bf4d33f0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:43.479405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-ca06a402-73dd-4f0f-b5d2-59370ef04300 req-99d826fc-b686-4a08-ade0-d8a7bf4d33f0 service nova] Creating event network-changed:0b2590ec-78e7-4638-85b3-4f3cb8ab82ec for instance 297abce4-955d-4411-8d84-3b14a31c5f19 on hv-cinder-83028 Jun 15 10:16:43.484458 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-ca06a402-73dd-4f0f-b5d2-59370ef04300 req-99d826fc-b686-4a08-ade0-d8a7bf4d33f0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027635 Jun 15 10:16:43.484969 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 235/470] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:43.969171 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d038542e-b6bd-466e-9b0c-719b4d9dfde5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:43.969973 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d038542e-b6bd-466e-9b0c-719b4d9dfde5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:43.977678 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d038542e-b6bd-466e-9b0c-719b4d9dfde5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:43.978067 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d038542e-b6bd-466e-9b0c-719b4d9dfde5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:43.978868 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d038542e-b6bd-466e-9b0c-719b4d9dfde5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:43.979306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d038542e-b6bd-466e-9b0c-719b4d9dfde5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:44.001610 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ecc1fb07-10df-4152-86f7-b37e574c1023 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:44.002535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ecc1fb07-10df-4152-86f7-b37e574c1023 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:44.009714 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ecc1fb07-10df-4152-86f7-b37e574c1023 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:44.010162 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ecc1fb07-10df-4152-86f7-b37e574c1023 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:44.011133 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ecc1fb07-10df-4152-86f7-b37e574c1023 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:44.011734 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ecc1fb07-10df-4152-86f7-b37e574c1023 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:44.176218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d038542e-b6bd-466e-9b0c-719b4d9dfde5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:44.188327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d038542e-b6bd-466e-9b0c-719b4d9dfde5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.223307 Jun 15 10:16:44.189089 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 236/471] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:43 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:44.208902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ecc1fb07-10df-4152-86f7-b37e574c1023 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:44.218000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ecc1fb07-10df-4152-86f7-b37e574c1023 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.220969 Jun 15 10:16:44.218607 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 236/472] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:43 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:45.206344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3a3d5483-3ea8-48c5-a396-657a6501d22e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:45.206960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3a3d5483-3ea8-48c5-a396-657a6501d22e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:45.214512 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a3d5483-3ea8-48c5-a396-657a6501d22e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:45.214995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a3d5483-3ea8-48c5-a396-657a6501d22e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:45.215759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a3d5483-3ea8-48c5-a396-657a6501d22e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:45.216195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a3d5483-3ea8-48c5-a396-657a6501d22e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:45.235102 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-497c1446-018c-4443-9ec4-6da37f4d22a6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:45.235721 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-497c1446-018c-4443-9ec4-6da37f4d22a6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:45.243298 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-497c1446-018c-4443-9ec4-6da37f4d22a6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:45.243892 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-497c1446-018c-4443-9ec4-6da37f4d22a6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:45.244818 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-497c1446-018c-4443-9ec4-6da37f4d22a6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:45.245332 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-497c1446-018c-4443-9ec4-6da37f4d22a6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:45.412933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3a3d5483-3ea8-48c5-a396-657a6501d22e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:45.416335 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:45.421084 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3a3d5483-3ea8-48c5-a396-657a6501d22e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.218554 Jun 15 10:16:45.421665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 237/473] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:45 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:45.424619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-497c1446-018c-4443-9ec4-6da37f4d22a6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:45.432596 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-497c1446-018c-4443-9ec4-6da37f4d22a6 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.201607 Jun 15 10:16:45.433155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 237/474] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:45 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:46.438664 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-64d79b56-78a8-4beb-98f4-4bb332c32446 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:46.441027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-64d79b56-78a8-4beb-98f4-4bb332c32446 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:46.448883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5bd2bb4a-25b5-40af-8b92-ecb7bf031c91 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:46.449490 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5bd2bb4a-25b5-40af-8b92-ecb7bf031c91 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:46.450454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-64d79b56-78a8-4beb-98f4-4bb332c32446 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:46.451523 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-64d79b56-78a8-4beb-98f4-4bb332c32446 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:46.452985 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-64d79b56-78a8-4beb-98f4-4bb332c32446 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:46.461228 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5bd2bb4a-25b5-40af-8b92-ecb7bf031c91 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:46.461768 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5bd2bb4a-25b5-40af-8b92-ecb7bf031c91 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:46.462428 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-64d79b56-78a8-4beb-98f4-4bb332c32446 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:46.462596 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5bd2bb4a-25b5-40af-8b92-ecb7bf031c91 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:46.463040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5bd2bb4a-25b5-40af-8b92-ecb7bf031c91 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:46.674151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5bd2bb4a-25b5-40af-8b92-ecb7bf031c91 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:46.681646 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5bd2bb4a-25b5-40af-8b92-ecb7bf031c91 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.236450 Jun 15 10:16:46.682231 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 238/475] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:46 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:46.689480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-64d79b56-78a8-4beb-98f4-4bb332c32446 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:46.698419 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-64d79b56-78a8-4beb-98f4-4bb332c32446 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.263888 Jun 15 10:16:46.708518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 238/476] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:46 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:47.699204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-33a46c65-7a3d-473e-9dc6-9562b319ca07 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:47.699851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-33a46c65-7a3d-473e-9dc6-9562b319ca07 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:47.706243 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-33a46c65-7a3d-473e-9dc6-9562b319ca07 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:47.706728 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-33a46c65-7a3d-473e-9dc6-9562b319ca07 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:47.707492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-33a46c65-7a3d-473e-9dc6-9562b319ca07 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:47.707928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-33a46c65-7a3d-473e-9dc6-9562b319ca07 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:47.715276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-965fc278-90e1-41a3-a14b-4eef32cfdc84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:47.715897 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-965fc278-90e1-41a3-a14b-4eef32cfdc84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:47.722296 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-965fc278-90e1-41a3-a14b-4eef32cfdc84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:47.722755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-965fc278-90e1-41a3-a14b-4eef32cfdc84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:47.723555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-965fc278-90e1-41a3-a14b-4eef32cfdc84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:47.723997 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-965fc278-90e1-41a3-a14b-4eef32cfdc84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:47.908657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-33a46c65-7a3d-473e-9dc6-9562b319ca07 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:47.915506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-965fc278-90e1-41a3-a14b-4eef32cfdc84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:47.916405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-33a46c65-7a3d-473e-9dc6-9562b319ca07 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.221087 Jun 15 10:16:47.916984 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 239/477] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:47 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:47.923141 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-965fc278-90e1-41a3-a14b-4eef32cfdc84 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.211734 Jun 15 10:16:47.923701 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 239/478] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:47 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:48.933618 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4f8875bb-c6e6-4288-bb8a-95a559e4194c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:48.934228 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4f8875bb-c6e6-4288-bb8a-95a559e4194c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:48.940612 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f8875bb-c6e6-4288-bb8a-95a559e4194c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:48.941059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f8875bb-c6e6-4288-bb8a-95a559e4194c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:48.941811 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f8875bb-c6e6-4288-bb8a-95a559e4194c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:48.942241 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4f8875bb-c6e6-4288-bb8a-95a559e4194c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:48.943129 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-73923d66-46e0-483e-beea-2bc1db9d9cec tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:48.943747 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-73923d66-46e0-483e-beea-2bc1db9d9cec tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:48.950292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73923d66-46e0-483e-beea-2bc1db9d9cec tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:48.950749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73923d66-46e0-483e-beea-2bc1db9d9cec tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:48.951543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73923d66-46e0-483e-beea-2bc1db9d9cec tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:48.951985 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-73923d66-46e0-483e-beea-2bc1db9d9cec tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:49.132811 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4f8875bb-c6e6-4288-bb8a-95a559e4194c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:49.139800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-73923d66-46e0-483e-beea-2bc1db9d9cec tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:49.140886 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4f8875bb-c6e6-4288-bb8a-95a559e4194c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.210948 Jun 15 10:16:49.141659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 240/479] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:48 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:49.153649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-73923d66-46e0-483e-beea-2bc1db9d9cec tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.214222 Jun 15 10:16:49.154231 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 240/480] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:48 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:50.158284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9db8d210-f611-4cf2-8ba9-96b413a1836d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:50.158901 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9db8d210-f611-4cf2-8ba9-96b413a1836d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:50.165638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9db8d210-f611-4cf2-8ba9-96b413a1836d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:50.166094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9db8d210-f611-4cf2-8ba9-96b413a1836d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:50.166895 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9db8d210-f611-4cf2-8ba9-96b413a1836d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:50.167339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9db8d210-f611-4cf2-8ba9-96b413a1836d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:50.170457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1dced97e-27f0-4e5f-9be7-026b310b7c43 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:50.171063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1dced97e-27f0-4e5f-9be7-026b310b7c43 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:50.176911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dced97e-27f0-4e5f-9be7-026b310b7c43 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:50.177355 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dced97e-27f0-4e5f-9be7-026b310b7c43 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:50.178118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dced97e-27f0-4e5f-9be7-026b310b7c43 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:50.179080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dced97e-27f0-4e5f-9be7-026b310b7c43 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:50.367022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9db8d210-f611-4cf2-8ba9-96b413a1836d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:50.370882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1dced97e-27f0-4e5f-9be7-026b310b7c43 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:50.375053 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9db8d210-f611-4cf2-8ba9-96b413a1836d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.220588 Jun 15 10:16:50.375637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 241/481] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:50 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:50.382180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1dced97e-27f0-4e5f-9be7-026b310b7c43 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.215263 Jun 15 10:16:50.383367 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 241/482] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:50 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:51.395698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e1080ff2-c218-404c-939d-eabee77e2b55 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:51.396307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e1080ff2-c218-404c-939d-eabee77e2b55 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:51.400005 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4750af2f-d405-4491-9059-9fec77555805 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:51.400646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4750af2f-d405-4491-9059-9fec77555805 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:51.403451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e1080ff2-c218-404c-939d-eabee77e2b55 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:51.403896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e1080ff2-c218-404c-939d-eabee77e2b55 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:51.404657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e1080ff2-c218-404c-939d-eabee77e2b55 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:51.405090 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e1080ff2-c218-404c-939d-eabee77e2b55 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:51.407097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4750af2f-d405-4491-9059-9fec77555805 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:51.407553 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4750af2f-d405-4491-9059-9fec77555805 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:51.408325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4750af2f-d405-4491-9059-9fec77555805 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:51.408768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4750af2f-d405-4491-9059-9fec77555805 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:51.599939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e1080ff2-c218-404c-939d-eabee77e2b55 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:51.604186 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4750af2f-d405-4491-9059-9fec77555805 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:51.608285 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e1080ff2-c218-404c-939d-eabee77e2b55 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.216500 Jun 15 10:16:51.608857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 242/483] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:51 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:51.611881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4750af2f-d405-4491-9059-9fec77555805 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.216449 Jun 15 10:16:51.617298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 242/484] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:51 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:52.624862 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f9063eff-e67d-40dc-a917-789b5d3ec743 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:52.625482 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f9063eff-e67d-40dc-a917-789b5d3ec743 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:52.628485 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3c635430-d046-4509-b425-f95134b63fb6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:52.629105 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3c635430-d046-4509-b425-f95134b63fb6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:52.632685 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9063eff-e67d-40dc-a917-789b5d3ec743 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:52.633145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9063eff-e67d-40dc-a917-789b5d3ec743 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:52.633918 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9063eff-e67d-40dc-a917-789b5d3ec743 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:52.634384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f9063eff-e67d-40dc-a917-789b5d3ec743 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:52.635862 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3c635430-d046-4509-b425-f95134b63fb6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:52.636345 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3c635430-d046-4509-b425-f95134b63fb6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:52.637117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3c635430-d046-4509-b425-f95134b63fb6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:52.637560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3c635430-d046-4509-b425-f95134b63fb6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:52.833749 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f9063eff-e67d-40dc-a917-789b5d3ec743 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:52.836086 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:52.842668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f9063eff-e67d-40dc-a917-789b5d3ec743 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.221618 Jun 15 10:16:52.843099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 243/485] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:52 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:52.845285 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3c635430-d046-4509-b425-f95134b63fb6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:52.853482 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3c635430-d046-4509-b425-f95134b63fb6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.228956 Jun 15 10:16:52.854038 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 243/486] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:52 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:53.859919 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8660edae-c7ea-4950-9ebf-bdb6d31065c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:53.860535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8660edae-c7ea-4950-9ebf-bdb6d31065c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:53.867700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8660edae-c7ea-4950-9ebf-bdb6d31065c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:53.868239 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8660edae-c7ea-4950-9ebf-bdb6d31065c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:53.869145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8660edae-c7ea-4950-9ebf-bdb6d31065c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:53.869633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8660edae-c7ea-4950-9ebf-bdb6d31065c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:53.870719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4c82f6b9-f37e-45ae-85a4-47d103e94902 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:53.871216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4c82f6b9-f37e-45ae-85a4-47d103e94902 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:53.878157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c82f6b9-f37e-45ae-85a4-47d103e94902 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:53.878642 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c82f6b9-f37e-45ae-85a4-47d103e94902 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:53.879407 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c82f6b9-f37e-45ae-85a4-47d103e94902 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:53.879841 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4c82f6b9-f37e-45ae-85a4-47d103e94902 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:54.294261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8660edae-c7ea-4950-9ebf-bdb6d31065c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:54.298205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4c82f6b9-f37e-45ae-85a4-47d103e94902 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:54.302599 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8660edae-c7ea-4950-9ebf-bdb6d31065c7 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.446373 Jun 15 10:16:54.303950 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 244/487] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:53 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:54.308287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4c82f6b9-f37e-45ae-85a4-47d103e94902 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.441869 Jun 15 10:16:54.316580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 244/488] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:53 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:55.319373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a55a1bf7-d4fd-4011-9635-576d5d39a4e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:55.320024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a55a1bf7-d4fd-4011-9635-576d5d39a4e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:55.324786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-41ad2f66-0db1-4af2-af31-2a9a63f379a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:55.325399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-41ad2f66-0db1-4af2-af31-2a9a63f379a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:55.326603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a55a1bf7-d4fd-4011-9635-576d5d39a4e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:55.327061 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a55a1bf7-d4fd-4011-9635-576d5d39a4e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:55.327835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a55a1bf7-d4fd-4011-9635-576d5d39a4e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:55.328284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a55a1bf7-d4fd-4011-9635-576d5d39a4e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:55.332115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-41ad2f66-0db1-4af2-af31-2a9a63f379a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:55.332564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-41ad2f66-0db1-4af2-af31-2a9a63f379a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:55.333354 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-41ad2f66-0db1-4af2-af31-2a9a63f379a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:55.333966 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-41ad2f66-0db1-4af2-af31-2a9a63f379a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:55.528830 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a55a1bf7-d4fd-4011-9635-576d5d39a4e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:55.533037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-41ad2f66-0db1-4af2-af31-2a9a63f379a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:55.536498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a55a1bf7-d4fd-4011-9635-576d5d39a4e0 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.220961 Jun 15 10:16:55.537152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 245/489] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:55 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:55.540808 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-41ad2f66-0db1-4af2-af31-2a9a63f379a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.219816 Jun 15 10:16:55.541364 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 245/490] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:55 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:56.553033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4d54767d-28c5-4630-a4d8-e89241622c49 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:56.554567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4d54767d-28c5-4630-a4d8-e89241622c49 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:56.557469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d519e19b-1a61-4e38-b0a6-d00073f6be14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:56.558081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d519e19b-1a61-4e38-b0a6-d00073f6be14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:56.561134 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d54767d-28c5-4630-a4d8-e89241622c49 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:56.561676 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d54767d-28c5-4630-a4d8-e89241622c49 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:56.562661 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d54767d-28c5-4630-a4d8-e89241622c49 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:56.563304 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4d54767d-28c5-4630-a4d8-e89241622c49 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:56.565013 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d519e19b-1a61-4e38-b0a6-d00073f6be14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:56.565509 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d519e19b-1a61-4e38-b0a6-d00073f6be14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:56.566344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d519e19b-1a61-4e38-b0a6-d00073f6be14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:56.566785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d519e19b-1a61-4e38-b0a6-d00073f6be14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:56.761262 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d519e19b-1a61-4e38-b0a6-d00073f6be14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:56.769134 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d519e19b-1a61-4e38-b0a6-d00073f6be14 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.215832 Jun 15 10:16:56.769704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 246/491] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:56 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:16:56.772654 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4d54767d-28c5-4630-a4d8-e89241622c49 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:56.780433 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4d54767d-28c5-4630-a4d8-e89241622c49 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.231322 Jun 15 10:16:56.781004 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 246/492] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:56 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:56.858845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-abac6b0b-a51a-46d4-9417-b61cab7b9ce6 req-481da794-039b-4386-8172-43d32ab3e34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e75928-75c5-447a-82cd-5f5ddcef696e", "name": "network-vif-plugged", "status": "completed", "tag": "26bc891a-8783-4664-86ab-a8714fbc52f6"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:16:56.868133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-abac6b0b-a51a-46d4-9417-b61cab7b9ce6 req-481da794-039b-4386-8172-43d32ab3e34e service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:56.869332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-abac6b0b-a51a-46d4-9417-b61cab7b9ce6 req-481da794-039b-4386-8172-43d32ab3e34e service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:56.882857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-abac6b0b-a51a-46d4-9417-b61cab7b9ce6 req-481da794-039b-4386-8172-43d32ab3e34e service nova] Creating event network-vif-plugged:26bc891a-8783-4664-86ab-a8714fbc52f6 for instance f6e75928-75c5-447a-82cd-5f5ddcef696e on hv-cinder-83028 Jun 15 10:16:56.888049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-abac6b0b-a51a-46d4-9417-b61cab7b9ce6 req-481da794-039b-4386-8172-43d32ab3e34e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033158 Jun 15 10:16:56.888649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 247/493] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:57.785954 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f344a6cf-38db-4583-8470-47b37342b1f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:57.786598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f344a6cf-38db-4583-8470-47b37342b1f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:57.793318 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f344a6cf-38db-4583-8470-47b37342b1f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:57.793774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f344a6cf-38db-4583-8470-47b37342b1f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:57.794577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f344a6cf-38db-4583-8470-47b37342b1f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:57.795032 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f344a6cf-38db-4583-8470-47b37342b1f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:57.797427 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c66f5341-c9fd-418e-b666-5321c8b571c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:57.798135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c66f5341-c9fd-418e-b666-5321c8b571c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:57.800591 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:57.807202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c66f5341-c9fd-418e-b666-5321c8b571c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:57.807650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c66f5341-c9fd-418e-b666-5321c8b571c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:57.808420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c66f5341-c9fd-418e-b666-5321c8b571c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:57.808863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c66f5341-c9fd-418e-b666-5321c8b571c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:57.990050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f344a6cf-38db-4583-8470-47b37342b1f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:57.998202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c66f5341-c9fd-418e-b666-5321c8b571c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:57.999147 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f344a6cf-38db-4583-8470-47b37342b1f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.217023 Jun 15 10:16:57.999809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 247/494] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:57 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:58.011194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c66f5341-c9fd-418e-b666-5321c8b571c8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.218024 Jun 15 10:16:58.011768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 248/495] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:57 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:59.017023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-86df7bfe-872e-4957-836c-1a19aeda6f85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:59.017557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-86df7bfe-872e-4957-836c-1a19aeda6f85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:59.025469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86df7bfe-872e-4957-836c-1a19aeda6f85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:59.025922 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86df7bfe-872e-4957-836c-1a19aeda6f85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:59.026923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86df7bfe-872e-4957-836c-1a19aeda6f85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:59.028132 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86df7bfe-872e-4957-836c-1a19aeda6f85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:59.029060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1744b32c-d604-4cde-b4a9-767073f0fbf3 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:59.029901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1744b32c-d604-4cde-b4a9-767073f0fbf3 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:16:59.036516 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1744b32c-d604-4cde-b4a9-767073f0fbf3 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:59.036960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1744b32c-d604-4cde-b4a9-767073f0fbf3 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:59.038347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1744b32c-d604-4cde-b4a9-767073f0fbf3 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:16:59.038784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1744b32c-d604-4cde-b4a9-767073f0fbf3 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:16:59.237732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-86df7bfe-872e-4957-836c-1a19aeda6f85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:59.241114 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1744b32c-d604-4cde-b4a9-767073f0fbf3 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:16:59.245525 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-86df7bfe-872e-4957-836c-1a19aeda6f85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.232431 Jun 15 10:16:59.246104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 248/496] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:59 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:59.248328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1744b32c-d604-4cde-b4a9-767073f0fbf3 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.224346 Jun 15 10:16:59.248892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 249/497] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:16:59 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:00.262520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7ba6c2f3-d150-46b6-8b62-d1a931040868 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:00.263136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7ba6c2f3-d150-46b6-8b62-d1a931040868 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:00.264961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0fbf9f52-bc28-4499-9331-808739c0121f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:00.265433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0fbf9f52-bc28-4499-9331-808739c0121f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:00.269563 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ba6c2f3-d150-46b6-8b62-d1a931040868 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:00.269925 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ba6c2f3-d150-46b6-8b62-d1a931040868 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:00.270739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ba6c2f3-d150-46b6-8b62-d1a931040868 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:00.271179 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7ba6c2f3-d150-46b6-8b62-d1a931040868 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:00.272313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbf9f52-bc28-4499-9331-808739c0121f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:00.272761 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbf9f52-bc28-4499-9331-808739c0121f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:00.273521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbf9f52-bc28-4499-9331-808739c0121f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:00.273948 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fbf9f52-bc28-4499-9331-808739c0121f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:00.495718 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7ba6c2f3-d150-46b6-8b62-d1a931040868 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:00.504072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7ba6c2f3-d150-46b6-8b62-d1a931040868 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.245451 Jun 15 10:17:00.504574 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 249/498] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:00 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:00.508119 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0fbf9f52-bc28-4499-9331-808739c0121f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:00.515791 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0fbf9f52-bc28-4499-9331-808739c0121f tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.254668 Jun 15 10:17:00.516373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 250/499] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:00 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:00.646605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-816463731", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1172135021", "security_groups": [{"name": "tempest-secgroup-smoke-21998658"}], "networks": [{"uuid": "46e5e202-b552-4d50-b4eb-4e6ed7d297dc"}], "block_device_mapping_v2": [{"uuid": "ba8f0b62-316f-4bf4-92c4-17f5c751a50d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:00.763250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] validate_networks() for [('46e5e202-b552-4d50-b4eb-4e6ed7d297dc', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:17:01.142959 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-def6547d-1851-42e3-a983-2cb849944bad req-5706004b-b753-4a63-b0c6-00c288ff4767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297abce4-955d-4411-8d84-3b14a31c5f19", "name": "network-vif-plugged", "status": "completed", "tag": "0b2590ec-78e7-4638-85b3-4f3cb8ab82ec"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:01.160261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-def6547d-1851-42e3-a983-2cb849944bad req-5706004b-b753-4a63-b0c6-00c288ff4767 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:01.161199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-def6547d-1851-42e3-a983-2cb849944bad req-5706004b-b753-4a63-b0c6-00c288ff4767 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:01.171064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:17:01.172314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:17:01.173076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:17:01.173667 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:17:01.174259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:17:01.175140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-def6547d-1851-42e3-a983-2cb849944bad req-5706004b-b753-4a63-b0c6-00c288ff4767 service nova] Creating event network-vif-plugged:0b2590ec-78e7-4638-85b3-4f3cb8ab82ec for instance 297abce4-955d-4411-8d84-3b14a31c5f19 on hv-cinder-83028 Jun 15 10:17:01.180855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-def6547d-1851-42e3-a983-2cb849944bad req-5706004b-b753-4a63-b0c6-00c288ff4767 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042163 Jun 15 10:17:01.182522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 251/500] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:17:01.186856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:01.187356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:01.188214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:01.188564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:01.205735 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Getting quotas for project d6a712f2d9e44cc6825ee925f3f068fd. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:17:01.211416 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Getting quotas for user 211501490d314544b1d60a8b42cd0cb1 and project d6a712f2d9e44cc6825ee925f3f068fd. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:17:01.277653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:17:01.280070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba8f0b62-316f-4bf4-92c4-17f5c751a50d',volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:17:01.423078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-79ba762d-bf7d-4aa3-9a38-c7ca0d90d0be tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.780237 Jun 15 10:17:01.423830 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 250/501] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:17:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:17:01.434964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ebccd8b2-0948-4a61-b7b2-776a9e3bf689 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:01.435710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ebccd8b2-0948-4a61-b7b2-776a9e3bf689 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:01.507863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ebccd8b2-0948-4a61-b7b2-776a9e3bf689 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:01.514929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ebccd8b2-0948-4a61-b7b2-776a9e3bf689 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1088 microversion: 2.1 time: 0.084710 Jun 15 10:17:01.515784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 252/502] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:01 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:01.537036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-28487f13-bf5b-4e1a-aca0-d44f3c77abaa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:01.540156 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-28487f13-bf5b-4e1a-aca0-d44f3c77abaa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:01.546575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28487f13-bf5b-4e1a-aca0-d44f3c77abaa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:01.547203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28487f13-bf5b-4e1a-aca0-d44f3c77abaa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:01.548873 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28487f13-bf5b-4e1a-aca0-d44f3c77abaa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:01.550176 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28487f13-bf5b-4e1a-aca0-d44f3c77abaa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:01.562320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aa52dd05-53eb-4919-8b95-b7b6e77a3e5d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:01.562952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-aa52dd05-53eb-4919-8b95-b7b6e77a3e5d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:01.580420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aa52dd05-53eb-4919-8b95-b7b6e77a3e5d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:01.582680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aa52dd05-53eb-4919-8b95-b7b6e77a3e5d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:01.583502 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aa52dd05-53eb-4919-8b95-b7b6e77a3e5d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:01.583944 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aa52dd05-53eb-4919-8b95-b7b6e77a3e5d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:01.810676 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-28487f13-bf5b-4e1a-aca0-d44f3c77abaa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:01.820014 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aa52dd05-53eb-4919-8b95-b7b6e77a3e5d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:01.820493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-28487f13-bf5b-4e1a-aca0-d44f3c77abaa tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.297045 Jun 15 10:17:01.830725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aa52dd05-53eb-4919-8b95-b7b6e77a3e5d tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1314 microversion: 2.1 time: 0.281667 Jun 15 10:17:01.830725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 253/503] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:01 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:01.832671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 251/504] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:01 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:02.533125 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-29f633da-923d-482f-bf7b-f79eea8d6fe1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:02.533784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-29f633da-923d-482f-bf7b-f79eea8d6fe1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:02.541122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29f633da-923d-482f-bf7b-f79eea8d6fe1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:02.541572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29f633da-923d-482f-bf7b-f79eea8d6fe1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:02.542371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29f633da-923d-482f-bf7b-f79eea8d6fe1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:02.542812 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-29f633da-923d-482f-bf7b-f79eea8d6fe1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:02.629488 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-29f633da-923d-482f-bf7b-f79eea8d6fe1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:02.638092 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-29f633da-923d-482f-bf7b-f79eea8d6fe1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1138 microversion: 2.1 time: 0.108767 Jun 15 10:17:02.638710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 254/505] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:02 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1138 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:02.837934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-af01d40c-afed-44b6-9cd3-04cb66b64cf7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:02.838624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-af01d40c-afed-44b6-9cd3-04cb66b64cf7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:02.845123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af01d40c-afed-44b6-9cd3-04cb66b64cf7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:02.845573 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af01d40c-afed-44b6-9cd3-04cb66b64cf7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:02.846364 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af01d40c-afed-44b6-9cd3-04cb66b64cf7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:02.846495 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1654ea45-b526-46d6-a9a5-f56c08bc11d8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:02.847067 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1654ea45-b526-46d6-a9a5-f56c08bc11d8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:02.847208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-af01d40c-afed-44b6-9cd3-04cb66b64cf7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:02.855298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1654ea45-b526-46d6-a9a5-f56c08bc11d8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:02.855982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1654ea45-b526-46d6-a9a5-f56c08bc11d8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:02.856759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1654ea45-b526-46d6-a9a5-f56c08bc11d8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:02.857196 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1654ea45-b526-46d6-a9a5-f56c08bc11d8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:03.079985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-af01d40c-afed-44b6-9cd3-04cb66b64cf7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:03.089160 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-af01d40c-afed-44b6-9cd3-04cb66b64cf7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.255568 Jun 15 10:17:03.107537 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1654ea45-b526-46d6-a9a5-f56c08bc11d8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:03.120801 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1654ea45-b526-46d6-a9a5-f56c08bc11d8 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1498 microversion: 2.1 time: 0.278283 Jun 15 10:17:03.121387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 255/506] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:02 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:03.121826 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 252/507] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:02 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:03.656161 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-456b2973-c7fa-45c5-bf76-7ea9719bcd8c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:03.660413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-456b2973-c7fa-45c5-bf76-7ea9719bcd8c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:03.667277 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-456b2973-c7fa-45c5-bf76-7ea9719bcd8c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:03.667733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-456b2973-c7fa-45c5-bf76-7ea9719bcd8c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:03.668605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-456b2973-c7fa-45c5-bf76-7ea9719bcd8c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:03.669046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-456b2973-c7fa-45c5-bf76-7ea9719bcd8c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:03.733046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-456b2973-c7fa-45c5-bf76-7ea9719bcd8c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:03.741367 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-456b2973-c7fa-45c5-bf76-7ea9719bcd8c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1138 microversion: 2.1 time: 0.088357 Jun 15 10:17:03.751104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 253/508] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:03 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:04.107074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aecd798e-825b-4743-8b02-a8d90dd04e19 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:04.107685 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-aecd798e-825b-4743-8b02-a8d90dd04e19 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:04.115063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aecd798e-825b-4743-8b02-a8d90dd04e19 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:04.118024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aecd798e-825b-4743-8b02-a8d90dd04e19 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:04.118832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aecd798e-825b-4743-8b02-a8d90dd04e19 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:04.119278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aecd798e-825b-4743-8b02-a8d90dd04e19 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:04.253215 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aecd798e-825b-4743-8b02-a8d90dd04e19 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:04.255544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:04.262261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aecd798e-825b-4743-8b02-a8d90dd04e19 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.159203 Jun 15 10:17:04.262880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 256/509] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:04 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:04.764405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f35f0af-5946-4f8b-9ea5-ea5cc896eac0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:04.765726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2f35f0af-5946-4f8b-9ea5-ea5cc896eac0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:04.775929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f35f0af-5946-4f8b-9ea5-ea5cc896eac0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:04.777101 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f35f0af-5946-4f8b-9ea5-ea5cc896eac0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:04.778213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f35f0af-5946-4f8b-9ea5-ea5cc896eac0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:04.778889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f35f0af-5946-4f8b-9ea5-ea5cc896eac0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:04.941807 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2f35f0af-5946-4f8b-9ea5-ea5cc896eac0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:04.952614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2f35f0af-5946-4f8b-9ea5-ea5cc896eac0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1138 microversion: 2.1 time: 0.197479 Jun 15 10:17:04.953265 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 254/510] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:04 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1138 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:05.280222 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-619360f7-bcd6-46a5-b794-b850d2b81b06 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:05.281547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-619360f7-bcd6-46a5-b794-b850d2b81b06 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:05.289313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-619360f7-bcd6-46a5-b794-b850d2b81b06 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:05.289766 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-619360f7-bcd6-46a5-b794-b850d2b81b06 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:05.290784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-619360f7-bcd6-46a5-b794-b850d2b81b06 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:05.291518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-619360f7-bcd6-46a5-b794-b850d2b81b06 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:05.460850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-619360f7-bcd6-46a5-b794-b850d2b81b06 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:05.469351 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-619360f7-bcd6-46a5-b794-b850d2b81b06 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.193222 Jun 15 10:17:05.480315 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 257/511] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:05 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:05.480947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-61d8617b-de58-42fe-9a89-65549ababe34 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:05.481683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-61d8617b-de58-42fe-9a89-65549ababe34 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:05.494973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-61d8617b-de58-42fe-9a89-65549ababe34 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:05.505000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-61d8617b-de58-42fe-9a89-65549ababe34 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:05.506621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-61d8617b-de58-42fe-9a89-65549ababe34 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:05.507084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-61d8617b-de58-42fe-9a89-65549ababe34 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:05.539837 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-61d8617b-de58-42fe-9a89-65549ababe34 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:17:05.680834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-61d8617b-de58-42fe-9a89-65549ababe34 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 204 len: 0 microversion: 2.1 time: 0.204123 Jun 15 10:17:05.681932 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 255/512] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:17:05 2022] DELETE /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:17:05.689755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f418fb44-4605-4544-854e-0aeff82f33c5 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:05.690404 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f418fb44-4605-4544-854e-0aeff82f33c5 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:05.698074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f418fb44-4605-4544-854e-0aeff82f33c5 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:05.698586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f418fb44-4605-4544-854e-0aeff82f33c5 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:05.699374 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f418fb44-4605-4544-854e-0aeff82f33c5 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:05.699811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f418fb44-4605-4544-854e-0aeff82f33c5 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:05.889309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f418fb44-4605-4544-854e-0aeff82f33c5 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:05.902569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f418fb44-4605-4544-854e-0aeff82f33c5 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.216498 Jun 15 10:17:05.903603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 258/513] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:05 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:05.970835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d2a16023-d15b-4bac-8d4d-73f4d61aae3a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:05.972380 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d2a16023-d15b-4bac-8d4d-73f4d61aae3a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:05.982116 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2a16023-d15b-4bac-8d4d-73f4d61aae3a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:05.982845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2a16023-d15b-4bac-8d4d-73f4d61aae3a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:05.983824 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2a16023-d15b-4bac-8d4d-73f4d61aae3a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:05.984559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d2a16023-d15b-4bac-8d4d-73f4d61aae3a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:06.067254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d2a16023-d15b-4bac-8d4d-73f4d61aae3a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:06.076727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d2a16023-d15b-4bac-8d4d-73f4d61aae3a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.110392 Jun 15 10:17:06.078137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 256/514] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:05 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:06.486995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-95065a2b-7657-433c-a04e-0d504f09d591 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:06.489371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-95065a2b-7657-433c-a04e-0d504f09d591 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:06.514459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-95065a2b-7657-433c-a04e-0d504f09d591 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:06.515250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-95065a2b-7657-433c-a04e-0d504f09d591 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:06.516287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-95065a2b-7657-433c-a04e-0d504f09d591 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:06.516883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-95065a2b-7657-433c-a04e-0d504f09d591 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:06.690613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-95065a2b-7657-433c-a04e-0d504f09d591 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:06.699927 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-95065a2b-7657-433c-a04e-0d504f09d591 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.216675 Jun 15 10:17:06.700700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 259/515] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:06 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:06.920347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-74a0ae18-29c9-4a34-a645-8f9bbe49b205 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:06.921235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-74a0ae18-29c9-4a34-a645-8f9bbe49b205 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:06.928158 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-74a0ae18-29c9-4a34-a645-8f9bbe49b205 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:06.928859 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-74a0ae18-29c9-4a34-a645-8f9bbe49b205 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:06.929638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-74a0ae18-29c9-4a34-a645-8f9bbe49b205 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:06.932907 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-74a0ae18-29c9-4a34-a645-8f9bbe49b205 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:07.095430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8e15798a-add3-42f9-b441-2fe49fcf7490 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:07.096258 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8e15798a-add3-42f9-b441-2fe49fcf7490 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:07.110254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8e15798a-add3-42f9-b441-2fe49fcf7490 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:07.123426 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-74a0ae18-29c9-4a34-a645-8f9bbe49b205 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:07.128945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8e15798a-add3-42f9-b441-2fe49fcf7490 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:07.130010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8e15798a-add3-42f9-b441-2fe49fcf7490 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:07.130973 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8e15798a-add3-42f9-b441-2fe49fcf7490 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:07.145249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-74a0ae18-29c9-4a34-a645-8f9bbe49b205 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.228875 Jun 15 10:17:07.145861 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 257/516] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:06 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:07.220591 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8e15798a-add3-42f9-b441-2fe49fcf7490 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:07.230222 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8e15798a-add3-42f9-b441-2fe49fcf7490 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.139195 Jun 15 10:17:07.239389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 260/517] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:07 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:07.719345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-77481b3c-a78f-40c5-9b0a-2c20b5c96ab9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:07.720535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-77481b3c-a78f-40c5-9b0a-2c20b5c96ab9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:07.735637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-77481b3c-a78f-40c5-9b0a-2c20b5c96ab9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:07.737002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-77481b3c-a78f-40c5-9b0a-2c20b5c96ab9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:07.738154 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-77481b3c-a78f-40c5-9b0a-2c20b5c96ab9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:07.738845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-77481b3c-a78f-40c5-9b0a-2c20b5c96ab9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:07.951596 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-77481b3c-a78f-40c5-9b0a-2c20b5c96ab9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:07.959715 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-77481b3c-a78f-40c5-9b0a-2c20b5c96ab9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.246031 Jun 15 10:17:07.960396 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 258/518] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:07 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:08.163922 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-82f160f5-d042-4e30-a866-ea8afe9c434c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:08.164514 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-82f160f5-d042-4e30-a866-ea8afe9c434c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:08.171608 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82f160f5-d042-4e30-a866-ea8afe9c434c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:08.172450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82f160f5-d042-4e30-a866-ea8afe9c434c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:08.173470 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82f160f5-d042-4e30-a866-ea8afe9c434c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:08.174063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82f160f5-d042-4e30-a866-ea8afe9c434c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:08.253059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-40d0ce57-41e4-4120-be9d-58ee659bc387 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:08.254034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-40d0ce57-41e4-4120-be9d-58ee659bc387 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:08.261916 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-40d0ce57-41e4-4120-be9d-58ee659bc387 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:08.262552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-40d0ce57-41e4-4120-be9d-58ee659bc387 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:08.263552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-40d0ce57-41e4-4120-be9d-58ee659bc387 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:08.264194 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-40d0ce57-41e4-4120-be9d-58ee659bc387 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:08.280801 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:08.370353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-40d0ce57-41e4-4120-be9d-58ee659bc387 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:08.378219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-40d0ce57-41e4-4120-be9d-58ee659bc387 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.129194 Jun 15 10:17:08.382716 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 259/519] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:08 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:08.506097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-82f160f5-d042-4e30-a866-ea8afe9c434c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:08.515656 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-82f160f5-d042-4e30-a866-ea8afe9c434c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.356081 Jun 15 10:17:08.516239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 261/520] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:08 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:08.980290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-634a1944-6317-418e-9bfc-2b5370776f2c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:08.980833 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-634a1944-6317-418e-9bfc-2b5370776f2c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:08.987438 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-634a1944-6317-418e-9bfc-2b5370776f2c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:08.988152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-634a1944-6317-418e-9bfc-2b5370776f2c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:08.989097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-634a1944-6317-418e-9bfc-2b5370776f2c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:08.989858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-634a1944-6317-418e-9bfc-2b5370776f2c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:09.254781 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-634a1944-6317-418e-9bfc-2b5370776f2c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:09.265433 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-634a1944-6317-418e-9bfc-2b5370776f2c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.292511 Jun 15 10:17:09.266125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 260/521] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:08 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:09.396625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dbd93b4e-2810-41f3-9ecd-95fb9ec36d87 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:09.397238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dbd93b4e-2810-41f3-9ecd-95fb9ec36d87 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:09.405639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dbd93b4e-2810-41f3-9ecd-95fb9ec36d87 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:09.406096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dbd93b4e-2810-41f3-9ecd-95fb9ec36d87 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:09.406895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dbd93b4e-2810-41f3-9ecd-95fb9ec36d87 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:09.407329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dbd93b4e-2810-41f3-9ecd-95fb9ec36d87 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:09.544122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2801af34-fb80-4c21-9ea7-36687575420a tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:09.547426 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2801af34-fb80-4c21-9ea7-36687575420a tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:09.560296 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2801af34-fb80-4c21-9ea7-36687575420a tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:09.561031 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2801af34-fb80-4c21-9ea7-36687575420a tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:09.562379 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2801af34-fb80-4c21-9ea7-36687575420a tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:09.563021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2801af34-fb80-4c21-9ea7-36687575420a tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:09.790946 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dbd93b4e-2810-41f3-9ecd-95fb9ec36d87 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:09.800712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dbd93b4e-2810-41f3-9ecd-95fb9ec36d87 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.408629 Jun 15 10:17:09.812122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 262/522] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:09 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:10.017017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2801af34-fb80-4c21-9ea7-36687575420a tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:10.032102 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2801af34-fb80-4c21-9ea7-36687575420a tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.501064 Jun 15 10:17:10.033476 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 261/523] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:09 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:10.283378 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3dae3045-4117-4dec-90f5-aacfd37d1ffc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:10.283997 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3dae3045-4117-4dec-90f5-aacfd37d1ffc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:10.301683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3dae3045-4117-4dec-90f5-aacfd37d1ffc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:10.305256 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3dae3045-4117-4dec-90f5-aacfd37d1ffc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:10.306165 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3dae3045-4117-4dec-90f5-aacfd37d1ffc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:10.306818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3dae3045-4117-4dec-90f5-aacfd37d1ffc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:10.525240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3dae3045-4117-4dec-90f5-aacfd37d1ffc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:10.550119 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3dae3045-4117-4dec-90f5-aacfd37d1ffc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.270595 Jun 15 10:17:10.551863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 263/524] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:10 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:10.820842 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ef33a1fa-7686-4389-92a0-771bca42e4f0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:10.821451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ef33a1fa-7686-4389-92a0-771bca42e4f0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:10.836554 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef33a1fa-7686-4389-92a0-771bca42e4f0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:10.837015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef33a1fa-7686-4389-92a0-771bca42e4f0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:10.837801 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef33a1fa-7686-4389-92a0-771bca42e4f0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:10.838256 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef33a1fa-7686-4389-92a0-771bca42e4f0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:10.977544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ef33a1fa-7686-4389-92a0-771bca42e4f0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:10.988660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ef33a1fa-7686-4389-92a0-771bca42e4f0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.172067 Jun 15 10:17:10.992551 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 262/525] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:10 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:11.051272 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5a522d6e-c538-47c3-8393-9bf528a9a1bc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:11.051896 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5a522d6e-c538-47c3-8393-9bf528a9a1bc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:11.062978 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a522d6e-c538-47c3-8393-9bf528a9a1bc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:11.063743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a522d6e-c538-47c3-8393-9bf528a9a1bc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:11.067306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a522d6e-c538-47c3-8393-9bf528a9a1bc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:11.068610 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5a522d6e-c538-47c3-8393-9bf528a9a1bc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:11.300620 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5a522d6e-c538-47c3-8393-9bf528a9a1bc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:11.320303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5a522d6e-c538-47c3-8393-9bf528a9a1bc tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.273242 Jun 15 10:17:11.320809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 264/526] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:11 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:11.572374 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34db7bf3-0969-43bd-b321-d39a5c495953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:11.573096 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34db7bf3-0969-43bd-b321-d39a5c495953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:11.597213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:11.598544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:11.602719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:11.615769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34db7bf3-0969-43bd-b321-d39a5c495953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:11.617133 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34db7bf3-0969-43bd-b321-d39a5c495953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:11.618620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34db7bf3-0969-43bd-b321-d39a5c495953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:11.619320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34db7bf3-0969-43bd-b321-d39a5c495953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:11.873182 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-34db7bf3-0969-43bd-b321-d39a5c495953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:11.882829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34db7bf3-0969-43bd-b321-d39a5c495953 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.317327 Jun 15 10:17:11.883736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 263/527] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:11 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:12.011983 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a0161015-e5c4-4d16-b306-eed88be0908d tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:12.012611 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a0161015-e5c4-4d16-b306-eed88be0908d tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:12.028506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:12.031118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0161015-e5c4-4d16-b306-eed88be0908d tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:12.031544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0161015-e5c4-4d16-b306-eed88be0908d tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:12.034056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0161015-e5c4-4d16-b306-eed88be0908d tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:12.034732 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0161015-e5c4-4d16-b306-eed88be0908d tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:12.138698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a0161015-e5c4-4d16-b306-eed88be0908d tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:12.148122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a0161015-e5c4-4d16-b306-eed88be0908d tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.144629 Jun 15 10:17:12.148722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 265/528] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:12 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:12.339185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1650d801-eaad-4c23-b8cc-628ac823fdfd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:12.341858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1650d801-eaad-4c23-b8cc-628ac823fdfd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:12.349389 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1650d801-eaad-4c23-b8cc-628ac823fdfd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:12.350024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1650d801-eaad-4c23-b8cc-628ac823fdfd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:12.351125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1650d801-eaad-4c23-b8cc-628ac823fdfd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:12.351671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1650d801-eaad-4c23-b8cc-628ac823fdfd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:12.535097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1650d801-eaad-4c23-b8cc-628ac823fdfd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:12.564727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1650d801-eaad-4c23-b8cc-628ac823fdfd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.219666 Jun 15 10:17:12.565387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 264/529] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:12 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:12.904152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-02f92435-79e9-4246-a050-fc15fbfdd042 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:12.905660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-02f92435-79e9-4246-a050-fc15fbfdd042 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:12.914863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-02f92435-79e9-4246-a050-fc15fbfdd042 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:12.915545 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-02f92435-79e9-4246-a050-fc15fbfdd042 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:12.916326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-02f92435-79e9-4246-a050-fc15fbfdd042 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:12.916755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-02f92435-79e9-4246-a050-fc15fbfdd042 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:13.134916 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-02f92435-79e9-4246-a050-fc15fbfdd042 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:13.145305 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-02f92435-79e9-4246-a050-fc15fbfdd042 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.247046 Jun 15 10:17:13.156531 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 266/530] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:12 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:13.164936 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7bd0e2cb-a50a-4677-bed6-078fb7cac7c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:13.165545 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7bd0e2cb-a50a-4677-bed6-078fb7cac7c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:13.173499 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7bd0e2cb-a50a-4677-bed6-078fb7cac7c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:13.173946 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7bd0e2cb-a50a-4677-bed6-078fb7cac7c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:13.180771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7bd0e2cb-a50a-4677-bed6-078fb7cac7c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:13.181240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7bd0e2cb-a50a-4677-bed6-078fb7cac7c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:13.261686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7bd0e2cb-a50a-4677-bed6-078fb7cac7c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:13.273297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7bd0e2cb-a50a-4677-bed6-078fb7cac7c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.112153 Jun 15 10:17:13.273907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 267/531] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:13 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:13.363626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-80d0952f-b175-4714-9710-9a07f0a5ecc1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Action: 'create', calling method: .version_select at 0x7fe2560c30d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-552614952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD94qS9xpIEYsomBrlOB93/LrpV3v3emANbzPdJN9+XSOREGpdv/BC82ZD2r/02OUsNwu9hqrTS1A9uBHnDCeZsvkpodYuVy6BVIgfGFzGo30dfMZn5hJRX+Z44r2q3fLw=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:13.378506 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-80d0952f-b175-4714-9710-9a07f0a5ecc1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Getting quotas for project c6cf56db2b454c688b9305ef587f407e. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:17:13.382981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-80d0952f-b175-4714-9710-9a07f0a5ecc1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Getting quotas for user 9ee3b5927ffa4ef5b7f617073e083a80 and project c6cf56db2b454c688b9305ef587f407e. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:17:13.404627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-80d0952f-b175-4714-9710-9a07f0a5ecc1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.286671 Jun 15 10:17:13.405217 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 265/532] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:17:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:17:13.582355 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0db8f01e-1fe0-43d3-993a-2cbed97e57a1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:13.582968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0db8f01e-1fe0-43d3-993a-2cbed97e57a1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:13.589328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0db8f01e-1fe0-43d3-993a-2cbed97e57a1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:13.589812 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0db8f01e-1fe0-43d3-993a-2cbed97e57a1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:13.590647 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0db8f01e-1fe0-43d3-993a-2cbed97e57a1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:13.591116 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0db8f01e-1fe0-43d3-993a-2cbed97e57a1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:13.733490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0db8f01e-1fe0-43d3-993a-2cbed97e57a1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:13.741467 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0db8f01e-1fe0-43d3-993a-2cbed97e57a1 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.163028 Jun 15 10:17:13.742048 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 268/533] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:13 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:14.164762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-995925f7-cb46-4f94-8bd1-3a6a0ceb78b6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:14.165588 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-995925f7-cb46-4f94-8bd1-3a6a0ceb78b6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:14.172989 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-995925f7-cb46-4f94-8bd1-3a6a0ceb78b6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:14.173836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-995925f7-cb46-4f94-8bd1-3a6a0ceb78b6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:14.174844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-995925f7-cb46-4f94-8bd1-3a6a0ceb78b6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:14.175779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-995925f7-cb46-4f94-8bd1-3a6a0ceb78b6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:14.293457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8245343b-e39e-4c00-98bf-9ca03d629946 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:14.294725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8245343b-e39e-4c00-98bf-9ca03d629946 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:14.301852 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8245343b-e39e-4c00-98bf-9ca03d629946 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:14.303251 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8245343b-e39e-4c00-98bf-9ca03d629946 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:14.304232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8245343b-e39e-4c00-98bf-9ca03d629946 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:14.304923 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8245343b-e39e-4c00-98bf-9ca03d629946 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:14.337816 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-995925f7-cb46-4f94-8bd1-3a6a0ceb78b6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:14.346021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-995925f7-cb46-4f94-8bd1-3a6a0ceb78b6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.185929 Jun 15 10:17:14.346946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 266/534] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:14 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:14.392221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8245343b-e39e-4c00-98bf-9ca03d629946 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:14.400881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8245343b-e39e-4c00-98bf-9ca03d629946 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.113309 Jun 15 10:17:14.401572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 269/535] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:14 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:14.762692 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3eaa6b08-acdd-400d-83e1-1bb31f2f1dbe tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:14.762692 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3eaa6b08-acdd-400d-83e1-1bb31f2f1dbe tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:14.766046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3eaa6b08-acdd-400d-83e1-1bb31f2f1dbe tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:14.766524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3eaa6b08-acdd-400d-83e1-1bb31f2f1dbe tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:14.767287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3eaa6b08-acdd-400d-83e1-1bb31f2f1dbe tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:14.767718 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3eaa6b08-acdd-400d-83e1-1bb31f2f1dbe tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:14.976864 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3eaa6b08-acdd-400d-83e1-1bb31f2f1dbe tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:14.988607 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3eaa6b08-acdd-400d-83e1-1bb31f2f1dbe tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.234669 Jun 15 10:17:14.989776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 267/536] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:14 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:15.037632 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dfa617fc-83fb-4dc3-a421-fa56db90c4af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:15.038436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dfa617fc-83fb-4dc3-a421-fa56db90c4af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:15.044725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dfa617fc-83fb-4dc3-a421-fa56db90c4af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:15.045486 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dfa617fc-83fb-4dc3-a421-fa56db90c4af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:15.046288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dfa617fc-83fb-4dc3-a421-fa56db90c4af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:15.046697 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dfa617fc-83fb-4dc3-a421-fa56db90c4af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:15.076302 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dfa617fc-83fb-4dc3-a421-fa56db90c4af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/ips" status: 200 len: 151 microversion: 2.20 time: 0.042820 Jun 15 10:17:15.077010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 270/537] 10.222.0.57 () {60 vars in 1288 bytes} [Wed Jun 15 10:17:15 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:17:15.363952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-11e84c65-8c6f-47b2-859b-50694fea0bde tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:15.366289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-11e84c65-8c6f-47b2-859b-50694fea0bde tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:15.378051 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11e84c65-8c6f-47b2-859b-50694fea0bde tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:15.378603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11e84c65-8c6f-47b2-859b-50694fea0bde tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:15.382083 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11e84c65-8c6f-47b2-859b-50694fea0bde tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:15.382754 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-11e84c65-8c6f-47b2-859b-50694fea0bde tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:15.421115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5c7d305a-ef3a-420d-b657-437c189450ca tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:15.422957 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5c7d305a-ef3a-420d-b657-437c189450ca tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:15.433032 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c7d305a-ef3a-420d-b657-437c189450ca tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:15.434166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c7d305a-ef3a-420d-b657-437c189450ca tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:15.435573 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c7d305a-ef3a-420d-b657-437c189450ca tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:15.436769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5c7d305a-ef3a-420d-b657-437c189450ca tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:15.544880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5c7d305a-ef3a-420d-b657-437c189450ca tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:15.553072 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5c7d305a-ef3a-420d-b657-437c189450ca tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.137514 Jun 15 10:17:15.568881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 271/538] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:15 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:15.626737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-11e84c65-8c6f-47b2-859b-50694fea0bde tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:15.635259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-11e84c65-8c6f-47b2-859b-50694fea0bde tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.275017 Jun 15 10:17:15.636035 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 268/539] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:15 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:16.006731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-053c30ef-6854-49c1-9725-c98b1adbf3ef tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:16.007384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-053c30ef-6854-49c1-9725-c98b1adbf3ef tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:16.013517 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-053c30ef-6854-49c1-9725-c98b1adbf3ef tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:16.013965 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-053c30ef-6854-49c1-9725-c98b1adbf3ef tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:16.014766 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-053c30ef-6854-49c1-9725-c98b1adbf3ef tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:16.015199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-053c30ef-6854-49c1-9725-c98b1adbf3ef tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:16.153728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-053c30ef-6854-49c1-9725-c98b1adbf3ef tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:16.161449 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-053c30ef-6854-49c1-9725-c98b1adbf3ef tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.159791 Jun 15 10:17:16.161938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 272/540] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:16 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:16.570846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ff908e50-c3b2-4c1d-8ef0-ea6d394d9464 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:16.571457 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ff908e50-c3b2-4c1d-8ef0-ea6d394d9464 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:16.580572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff908e50-c3b2-4c1d-8ef0-ea6d394d9464 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:16.580572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff908e50-c3b2-4c1d-8ef0-ea6d394d9464 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:16.581286 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff908e50-c3b2-4c1d-8ef0-ea6d394d9464 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:16.582029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ff908e50-c3b2-4c1d-8ef0-ea6d394d9464 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:16.651598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ff908e50-c3b2-4c1d-8ef0-ea6d394d9464 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:16.652921 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8aefbe8e-1e49-40a2-9805-59ead43ac8b9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:16.653640 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8aefbe8e-1e49-40a2-9805-59ead43ac8b9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:16.659399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ff908e50-c3b2-4c1d-8ef0-ea6d394d9464 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.093364 Jun 15 10:17:16.660056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 269/541] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:16 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:16.660303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8aefbe8e-1e49-40a2-9805-59ead43ac8b9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:16.660513 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8aefbe8e-1e49-40a2-9805-59ead43ac8b9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:16.661498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8aefbe8e-1e49-40a2-9805-59ead43ac8b9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:16.662053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8aefbe8e-1e49-40a2-9805-59ead43ac8b9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:16.793179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8aefbe8e-1e49-40a2-9805-59ead43ac8b9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:16.795458 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:16.803764 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8aefbe8e-1e49-40a2-9805-59ead43ac8b9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.154613 Jun 15 10:17:16.804337 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 273/542] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:16 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:17.177972 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7c0a2d98-244c-45b4-a69f-a4a316234c58 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:17.178668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7c0a2d98-244c-45b4-a69f-a4a316234c58 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:17.184649 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c0a2d98-244c-45b4-a69f-a4a316234c58 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:17.185128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c0a2d98-244c-45b4-a69f-a4a316234c58 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:17.185935 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c0a2d98-244c-45b4-a69f-a4a316234c58 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:17.186350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c0a2d98-244c-45b4-a69f-a4a316234c58 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:17.311449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7c0a2d98-244c-45b4-a69f-a4a316234c58 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:17.319425 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7c0a2d98-244c-45b4-a69f-a4a316234c58 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.145881 Jun 15 10:17:17.319989 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 270/543] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:17 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:17.679848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d06b6a29-a739-4cce-b358-1769ad23a94f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:17.679848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d06b6a29-a739-4cce-b358-1769ad23a94f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:17.685153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d06b6a29-a739-4cce-b358-1769ad23a94f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:17.685644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d06b6a29-a739-4cce-b358-1769ad23a94f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:17.686457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d06b6a29-a739-4cce-b358-1769ad23a94f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:17.686977 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d06b6a29-a739-4cce-b358-1769ad23a94f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:17.757022 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d06b6a29-a739-4cce-b358-1769ad23a94f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:17.765386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d06b6a29-a739-4cce-b358-1769ad23a94f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1186 microversion: 2.1 time: 0.092147 Jun 15 10:17:17.771045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 274/544] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:17 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:17.820196 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b11bd0ae-c495-4d21-8484-e724fd29bead tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:17.821416 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b11bd0ae-c495-4d21-8484-e724fd29bead tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:17.828150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b11bd0ae-c495-4d21-8484-e724fd29bead tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:17.828600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b11bd0ae-c495-4d21-8484-e724fd29bead tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:17.829459 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b11bd0ae-c495-4d21-8484-e724fd29bead tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:17.829889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b11bd0ae-c495-4d21-8484-e724fd29bead tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:17.993080 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b11bd0ae-c495-4d21-8484-e724fd29bead tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:18.001406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b11bd0ae-c495-4d21-8484-e724fd29bead tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1372 microversion: 2.1 time: 0.185285 Jun 15 10:17:18.002213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 271/545] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:17 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:18.337372 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-003fba3d-ff26-405b-a1a0-15d814bbb17c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:18.338034 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-003fba3d-ff26-405b-a1a0-15d814bbb17c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:18.344485 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-003fba3d-ff26-405b-a1a0-15d814bbb17c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:18.345032 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-003fba3d-ff26-405b-a1a0-15d814bbb17c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:18.345924 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-003fba3d-ff26-405b-a1a0-15d814bbb17c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:18.346542 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-003fba3d-ff26-405b-a1a0-15d814bbb17c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:18.501739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-003fba3d-ff26-405b-a1a0-15d814bbb17c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:18.515021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-003fba3d-ff26-405b-a1a0-15d814bbb17c tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1504 microversion: 2.1 time: 0.182262 Jun 15 10:17:18.517300 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 275/546] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:18 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:18.629990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f328804e-bdf8-4ebd-a4f2-5a74d1fd68e4 req-d11d0486-0226-451b-a679-80d58cc49af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e75928-75c5-447a-82cd-5f5ddcef696e", "name": "network-vif-unplugged", "status": "completed", "tag": "26bc891a-8783-4664-86ab-a8714fbc52f6"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:18.642285 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f328804e-bdf8-4ebd-a4f2-5a74d1fd68e4 req-d11d0486-0226-451b-a679-80d58cc49af5 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:18.643112 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f328804e-bdf8-4ebd-a4f2-5a74d1fd68e4 req-d11d0486-0226-451b-a679-80d58cc49af5 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:18.658176 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f328804e-bdf8-4ebd-a4f2-5a74d1fd68e4 req-d11d0486-0226-451b-a679-80d58cc49af5 service nova] Creating event network-vif-unplugged:26bc891a-8783-4664-86ab-a8714fbc52f6 for instance f6e75928-75c5-447a-82cd-5f5ddcef696e on hv-cinder-83028 Jun 15 10:17:18.664501 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f328804e-bdf8-4ebd-a4f2-5a74d1fd68e4 req-d11d0486-0226-451b-a679-80d58cc49af5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038880 Jun 15 10:17:18.665515 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 272/547] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:17:18.783954 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d05e2deb-2287-4a5e-aa0c-5efc80f27db4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:18.784843 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d05e2deb-2287-4a5e-aa0c-5efc80f27db4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:18.791853 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d05e2deb-2287-4a5e-aa0c-5efc80f27db4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:18.792363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d05e2deb-2287-4a5e-aa0c-5efc80f27db4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:18.793236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d05e2deb-2287-4a5e-aa0c-5efc80f27db4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:18.793732 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d05e2deb-2287-4a5e-aa0c-5efc80f27db4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:18.863391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d05e2deb-2287-4a5e-aa0c-5efc80f27db4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:18.874413 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d05e2deb-2287-4a5e-aa0c-5efc80f27db4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1204 microversion: 2.1 time: 0.094307 Jun 15 10:17:18.875841 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 276/548] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:18 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:18.919866 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-aec11769-90e1-4e50-9857-518d51c2327b req-541077c4-b1b1-488b-a35a-e2a8d2727f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e75928-75c5-447a-82cd-5f5ddcef696e", "name": "network-vif-deleted", "tag": "26bc891a-8783-4664-86ab-a8714fbc52f6"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:18.929149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-aec11769-90e1-4e50-9857-518d51c2327b req-541077c4-b1b1-488b-a35a-e2a8d2727f46 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:18.929848 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-aec11769-90e1-4e50-9857-518d51c2327b req-541077c4-b1b1-488b-a35a-e2a8d2727f46 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:18.944943 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-aec11769-90e1-4e50-9857-518d51c2327b req-541077c4-b1b1-488b-a35a-e2a8d2727f46 service nova] Creating event network-vif-deleted:26bc891a-8783-4664-86ab-a8714fbc52f6 for instance f6e75928-75c5-447a-82cd-5f5ddcef696e on hv-cinder-83028 Jun 15 10:17:18.952321 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-aec11769-90e1-4e50-9857-518d51c2327b req-541077c4-b1b1-488b-a35a-e2a8d2727f46 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036608 Jun 15 10:17:18.953196 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 273/549] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:17:19.019684 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-85887831-6895-493a-b042-ec29f103aa85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:19.021755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-85887831-6895-493a-b042-ec29f103aa85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:19.030193 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-85887831-6895-493a-b042-ec29f103aa85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.030684 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-85887831-6895-493a-b042-ec29f103aa85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.031469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-85887831-6895-493a-b042-ec29f103aa85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.031913 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-85887831-6895-493a-b042-ec29f103aa85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.178358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-85887831-6895-493a-b042-ec29f103aa85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:19.185800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-85887831-6895-493a-b042-ec29f103aa85 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1566 microversion: 2.1 time: 0.171298 Jun 15 10:17:19.195873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 277/550] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:19 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:19.202801 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2a983c50-b2b6-4f2a-a5d0-24d2decf4563 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:19.203382 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2a983c50-b2b6-4f2a-a5d0-24d2decf4563 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:19.210383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a983c50-b2b6-4f2a-a5d0-24d2decf4563 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.211060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a983c50-b2b6-4f2a-a5d0-24d2decf4563 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.212009 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a983c50-b2b6-4f2a-a5d0-24d2decf4563 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.212420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a983c50-b2b6-4f2a-a5d0-24d2decf4563 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.311534 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-362cd9c4-d7c8-44b6-9ec4-43c709237e5f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:19.312400 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-362cd9c4-d7c8-44b6-9ec4-43c709237e5f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:19.320843 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-362cd9c4-d7c8-44b6-9ec4-43c709237e5f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.321557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-362cd9c4-d7c8-44b6-9ec4-43c709237e5f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.327516 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-362cd9c4-d7c8-44b6-9ec4-43c709237e5f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.328260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-362cd9c4-d7c8-44b6-9ec4-43c709237e5f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.346813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2a983c50-b2b6-4f2a-a5d0-24d2decf4563 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147871 Jun 15 10:17:19.348108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 274/551] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 10:17:19 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:17:19.370590 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-362cd9c4-d7c8-44b6-9ec4-43c709237e5f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lazy-loading 'flavor' on Instance uuid af5ab626-a7eb-407e-b8a9-a768e57d4022 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:17:19.534401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:19.540914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:19.556615 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.557423 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.558449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.564745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.629008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.629513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.631559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lazy-loading 'fault' on Instance uuid f6e75928-75c5-447a-82cd-5f5ddcef696e {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:17:19.707880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb45ed9fab334d019bf31a366856735f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553475cebf3147b393f2c4238699c17e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:19.716053 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a8e0c9e0-5881-496c-9910-9f52bea227fd tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 200 len: 1304 microversion: 2.1 time: 0.185437 Jun 15 10:17:19.716641 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 275/552] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:19 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:19.761671 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-362cd9c4-d7c8-44b6-9ec4-43c709237e5f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/action" status: 202 len: 0 microversion: 2.20 time: 0.455554 Jun 15 10:17:19.762386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 278/553] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Jun 15 10:17:19 2022] POST /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:17:19.771012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:19.772073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:19.778240 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.778662 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.779423 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.779863 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.904627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a68bb5ea-2cf9-41f9-a239-34b3644c1919 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:19.906050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a68bb5ea-2cf9-41f9-a239-34b3644c1919 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:19.923276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a68bb5ea-2cf9-41f9-a239-34b3644c1919 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.923787 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a68bb5ea-2cf9-41f9-a239-34b3644c1919 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:19.924503 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a68bb5ea-2cf9-41f9-a239-34b3644c1919 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:19.927362 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a68bb5ea-2cf9-41f9-a239-34b3644c1919 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:20.141268 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:20.153469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:20.155002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:20.156450 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8ed5ffeb-1a63-4439-9947-ed70927eccd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.389912 Jun 15 10:17:20.157579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 276/554] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:19 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:20.376234 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a68bb5ea-2cf9-41f9-a239-34b3644c1919 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:20.393907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a68bb5ea-2cf9-41f9-a239-34b3644c1919 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.503228 Jun 15 10:17:20.395185 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 279/555] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:19 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:20.734398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:20.735333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] [instance: f6e75928-75c5-447a-82cd-5f5ddcef696e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:20.743531 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:20.744316 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:20.745309 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:20.746257 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:20.764138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] HTTP exception thrown: Instance f6e75928-75c5-447a-82cd-5f5ddcef696e could not be found. Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Request method failure captured: Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e HTTP/1.1 Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbFW_2AQVEmaOPh25SXKyn9oL2IIBY1U0An8EgxmgS9tWlcUldirx_mPWCQlF-s21Ecgj2yYCquw4Ca__P2xW4cX9aeXcFY155DO0hyPAKpk8xpw4nFanCkrhgaICuqCS0dg3RlnMoJsWrzrF_8ST1U0L-dvAp9lNDQzwBKOJ4N6LuY Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 553475cebf3147b393f2c4238699c17e Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesActionsTest-273895664 Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:17:20.766191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_553475cebf3147b393f2c4238699c17e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/553475cebf3147b393f2c4238699c17e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/553475cebf3147b393f2c4238699c17e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/553475cebf3147b393f2c4238699c17e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesActionsTest-273895664 Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 553475cebf3147b393f2c4238699c17e Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesActionsTest-273895664 Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesActionsTest-273895664-project Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: bb45ed9fab334d019bf31a366856735f Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesActionsTest-273895664-project Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance f6e75928-75c5-447a-82cd-5f5ddcef696e could not be found. Jun 15 10:17:20.767602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': 'f6e75928-75c5-447a-82cd-5f5ddcef696e'} Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e75928-75c5-447a-82cd-5f5ddcef696e could not be found. Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:17:20.768327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e75928-75c5-447a-82cd-5f5ddcef696e could not be found. Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e75928-75c5-447a-82cd-5f5ddcef696e could not be found. Jun 15 10:17:20.769621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:20.772723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] Returning 404 to user: Instance f6e75928-75c5-447a-82cd-5f5ddcef696e could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:17:20.774041 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-26614e34-97e6-4fc7-aef9-7b8ed8badc18 tempest-VolumesActionsTest-273895664 tempest-VolumesActionsTest-273895664-project] 10.222.0.57 "GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e" status: 404 len: 111 microversion: 2.1 time: 0.043488 Jun 15 10:17:20.775190 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 277/556] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:20 2022] GET /compute/v2.1/servers/f6e75928-75c5-447a-82cd-5f5ddcef696e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:17:20.977935 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-9838f6bc-f06e-40db-9a13-62db2fdf56db req-47cf56ce-90bf-4e3b-b4bf-9a86d8b043e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017fbaea-de4e-4981-b1a7-f85fc6d5fc74", "tag": "a0d42ef5-c08b-4c5d-807e-fde0e4998fd2"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:21.002581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-9838f6bc-f06e-40db-9a13-62db2fdf56db req-47cf56ce-90bf-4e3b-b4bf-9a86d8b043e5 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:21.003321 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-9838f6bc-f06e-40db-9a13-62db2fdf56db req-47cf56ce-90bf-4e3b-b4bf-9a86d8b043e5 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:21.020660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-9838f6bc-f06e-40db-9a13-62db2fdf56db req-47cf56ce-90bf-4e3b-b4bf-9a86d8b043e5 service nova] Creating event network-changed:a0d42ef5-c08b-4c5d-807e-fde0e4998fd2 for instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 on hv-cinder-83028 Jun 15 10:17:21.031587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-9838f6bc-f06e-40db-9a13-62db2fdf56db req-47cf56ce-90bf-4e3b-b4bf-9a86d8b043e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064125 Jun 15 10:17:21.032666 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 280/557] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:17:21.136995 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e4fa3c42-c009-4339-9255-0bd219a3c0de tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:21.137515 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e4fa3c42-c009-4339-9255-0bd219a3c0de tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:21.149601 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4fa3c42-c009-4339-9255-0bd219a3c0de tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:21.150204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4fa3c42-c009-4339-9255-0bd219a3c0de tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:21.155930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4fa3c42-c009-4339-9255-0bd219a3c0de tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:21.156614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4fa3c42-c009-4339-9255-0bd219a3c0de tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:21.178440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:21.179159 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:21.222575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:21.222575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:21.224248 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:21.224716 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:21.417684 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-e4fa3c42-c009-4339-9255-0bd219a3c0de tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lazy-loading 'services' on Instance uuid 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:17:21.424788 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:21.435256 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:21.437105 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:21.438663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-905b209d-e790-4a97-b6af-e07b502bfbe2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.266116 Jun 15 10:17:21.439772 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 281/558] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:21 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:21.448726 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3319cab0-221c-4dbd-95f5-4dc64056284e req-90eca4c9-e95d-461d-855e-fb411314ad62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297abce4-955d-4411-8d84-3b14a31c5f19", "tag": "0b2590ec-78e7-4638-85b3-4f3cb8ab82ec"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:21.459094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3319cab0-221c-4dbd-95f5-4dc64056284e req-90eca4c9-e95d-461d-855e-fb411314ad62 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:21.461071 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3319cab0-221c-4dbd-95f5-4dc64056284e req-90eca4c9-e95d-461d-855e-fb411314ad62 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:21.467316 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:21.477156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3319cab0-221c-4dbd-95f5-4dc64056284e req-90eca4c9-e95d-461d-855e-fb411314ad62 service nova] Creating event network-changed:0b2590ec-78e7-4638-85b3-4f3cb8ab82ec for instance 297abce4-955d-4411-8d84-3b14a31c5f19 on hv-cinder-83028 Jun 15 10:17:21.482893 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3319cab0-221c-4dbd-95f5-4dc64056284e req-90eca4c9-e95d-461d-855e-fb411314ad62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041790 Jun 15 10:17:21.484028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 282/559] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:17:21.492429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-09bbba0b-ca15-4063-b82d-c9112917d97f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:21.494665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-09bbba0b-ca15-4063-b82d-c9112917d97f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:21.504098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-09bbba0b-ca15-4063-b82d-c9112917d97f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:21.506393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-09bbba0b-ca15-4063-b82d-c9112917d97f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:21.507364 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-09bbba0b-ca15-4063-b82d-c9112917d97f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:21.507899 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-09bbba0b-ca15-4063-b82d-c9112917d97f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:21.612715 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e4fa3c42-c009-4339-9255-0bd219a3c0de tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "DELETE /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e/os-volume_attachments/eeb1f905-81fd-4ae6-b36e-9317d50af4b7" status: 202 len: 0 microversion: 2.1 time: 0.477209 Jun 15 10:17:21.614729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 278/560] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:17:21 2022] DELETE /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e/os-volume_attachments/eeb1f905-81fd-4ae6-b36e-9317d50af4b7 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:17:21.690010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-09bbba0b-ca15-4063-b82d-c9112917d97f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:21.699697 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-09bbba0b-ca15-4063-b82d-c9112917d97f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.214111 Jun 15 10:17:21.706567 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 283/561] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:21 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:22.458904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:22.459612 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:22.465782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:22.466244 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:22.467040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:22.467484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:22.610225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:22.619688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:22.621209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:22.622451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-603aa154-019f-4427-93e2-ceace72aed9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.169107 Jun 15 10:17:22.623014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 279/562] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:22 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:22.717518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-49e40053-58ed-440f-86a3-3a38c4026e4c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:22.718790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-49e40053-58ed-440f-86a3-3a38c4026e4c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:22.726454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49e40053-58ed-440f-86a3-3a38c4026e4c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:22.727168 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49e40053-58ed-440f-86a3-3a38c4026e4c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:22.728810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49e40053-58ed-440f-86a3-3a38c4026e4c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:22.730163 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49e40053-58ed-440f-86a3-3a38c4026e4c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:22.883959 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-49e40053-58ed-440f-86a3-3a38c4026e4c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:22.891680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-49e40053-58ed-440f-86a3-3a38c4026e4c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.178657 Jun 15 10:17:22.892247 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 284/563] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:22 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:23.640888 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:23.641502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:23.643501 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=4 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:23.649851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:23.650336 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:23.651137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:23.651579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:23.792076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:23.800580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:23.803008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:23.804174 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8f6aef10-7f98-4c75-afdb-10838c26b19f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.167166 Jun 15 10:17:23.804724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 280/564] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:23 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:23.909433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-93e9db30-cd26-4853-8164-7b04cb716753 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:23.909962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-93e9db30-cd26-4853-8164-7b04cb716753 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:23.917269 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93e9db30-cd26-4853-8164-7b04cb716753 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:23.917712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93e9db30-cd26-4853-8164-7b04cb716753 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:23.918495 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93e9db30-cd26-4853-8164-7b04cb716753 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:23.918926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93e9db30-cd26-4853-8164-7b04cb716753 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:24.060291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-93e9db30-cd26-4853-8164-7b04cb716753 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:24.068391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-93e9db30-cd26-4853-8164-7b04cb716753 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.163043 Jun 15 10:17:24.068945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 285/565] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:23 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:24.822625 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:24.823305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:24.832195 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:24.833516 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:24.834611 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:24.835305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:24.982482 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:24.991660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:24.993203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:24.994396 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f0d92ad8-2749-47dc-b802-fde9d74aab81 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.175712 Jun 15 10:17:24.994956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 281/566] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:24 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:25.088124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d7401d38-d8ce-4a1e-87de-f10e7f001100 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:25.088714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d7401d38-d8ce-4a1e-87de-f10e7f001100 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:25.095245 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7401d38-d8ce-4a1e-87de-f10e7f001100 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:25.095684 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7401d38-d8ce-4a1e-87de-f10e7f001100 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:25.096441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7401d38-d8ce-4a1e-87de-f10e7f001100 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:25.096866 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7401d38-d8ce-4a1e-87de-f10e7f001100 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:25.245465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d7401d38-d8ce-4a1e-87de-f10e7f001100 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:25.252969 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d7401d38-d8ce-4a1e-87de-f10e7f001100 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.168648 Jun 15 10:17:25.253525 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 286/567] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:25 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:26.013440 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:26.014200 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:26.021017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:26.021474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:26.022534 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:26.023267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:26.163722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:26.172066 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:26.173611 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:26.174845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-83e1da0a-3cf0-4587-8cff-306195179eaa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.166865 Jun 15 10:17:26.175441 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 282/568] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:26 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:26.273748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4e453881-c9f4-4851-8c43-6bdfe0423f8e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:26.274690 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4e453881-c9f4-4851-8c43-6bdfe0423f8e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:26.283464 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e453881-c9f4-4851-8c43-6bdfe0423f8e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:26.283907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e453881-c9f4-4851-8c43-6bdfe0423f8e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:26.284668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e453881-c9f4-4851-8c43-6bdfe0423f8e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:26.285099 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e453881-c9f4-4851-8c43-6bdfe0423f8e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:26.434465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4e453881-c9f4-4851-8c43-6bdfe0423f8e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:26.443068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4e453881-c9f4-4851-8c43-6bdfe0423f8e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.175418 Jun 15 10:17:26.446323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 287/569] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:26 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:27.193454 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:27.194064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:27.200666 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:27.201116 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:27.201871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:27.202332 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:27.332233 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:27.340205 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:27.341705 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:27.342906 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-467c15f4-bb78-402e-b871-b6c76b150b12 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.153885 Jun 15 10:17:27.343457 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 283/570] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:27 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:27.469856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e3e11b3e-abb1-4e28-900e-0e87560e260e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:27.470531 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e3e11b3e-abb1-4e28-900e-0e87560e260e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:27.484367 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3e11b3e-abb1-4e28-900e-0e87560e260e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:27.484820 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3e11b3e-abb1-4e28-900e-0e87560e260e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:27.485625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3e11b3e-abb1-4e28-900e-0e87560e260e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:27.486043 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3e11b3e-abb1-4e28-900e-0e87560e260e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:27.619471 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e3e11b3e-abb1-4e28-900e-0e87560e260e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:27.626972 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e3e11b3e-abb1-4e28-900e-0e87560e260e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.160912 Jun 15 10:17:27.627553 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 288/571] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:27 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:28.364402 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:28.365435 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:28.372760 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:28.373582 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:28.375023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:28.375595 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:28.508319 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:28.516325 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:28.517899 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:28.519085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-83fd6906-d585-4fbb-9ef2-521cc9903dfe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.160541 Jun 15 10:17:28.521609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 284/572] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:28 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:28.644260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8833649b-ab66-4f1a-b330-e7c6adfd9984 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:28.645406 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8833649b-ab66-4f1a-b330-e7c6adfd9984 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:28.647968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=84 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:28.653149 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8833649b-ab66-4f1a-b330-e7c6adfd9984 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:28.653599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8833649b-ab66-4f1a-b330-e7c6adfd9984 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:28.654386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8833649b-ab66-4f1a-b330-e7c6adfd9984 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:28.654825 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8833649b-ab66-4f1a-b330-e7c6adfd9984 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:28.800286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8833649b-ab66-4f1a-b330-e7c6adfd9984 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:28.803808 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:28.810733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8833649b-ab66-4f1a-b330-e7c6adfd9984 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.170390 Jun 15 10:17:28.811296 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 289/573] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:28 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:29.537036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:29.537681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:29.544171 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:29.544626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:29.545408 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:29.546501 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:29.678534 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:29.686305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:29.687830 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:29.688968 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-36e59501-3be0-4360-900d-c72393f52f56 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.155918 Jun 15 10:17:29.689518 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 285/574] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:29 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:17:29.834580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b3a63550-407a-4938-92d1-086069e3bfec tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:29.835303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b3a63550-407a-4938-92d1-086069e3bfec tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:29.847915 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3a63550-407a-4938-92d1-086069e3bfec tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:29.847915 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3a63550-407a-4938-92d1-086069e3bfec tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:29.848639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3a63550-407a-4938-92d1-086069e3bfec tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:29.849082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3a63550-407a-4938-92d1-086069e3bfec tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:30.014042 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b3a63550-407a-4938-92d1-086069e3bfec tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:30.022182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b3a63550-407a-4938-92d1-086069e3bfec tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.197239 Jun 15 10:17:30.022820 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 290/575] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:29 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:30.709405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:30.710225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:30.716494 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:30.717049 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:30.717907 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:30.718443 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:30.871817 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:30.884561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:30.888802 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:30.890012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dfa7f153-05de-4516-856c-797cf7ec189c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.185425 Jun 15 10:17:30.891294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 286/576] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:30 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:31.041227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c84aea26-5184-4216-8799-c0b1d697c3c1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:31.042753 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c84aea26-5184-4216-8799-c0b1d697c3c1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:31.049666 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c84aea26-5184-4216-8799-c0b1d697c3c1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:31.050474 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c84aea26-5184-4216-8799-c0b1d697c3c1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:31.051942 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c84aea26-5184-4216-8799-c0b1d697c3c1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:31.052398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c84aea26-5184-4216-8799-c0b1d697c3c1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:31.248066 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c84aea26-5184-4216-8799-c0b1d697c3c1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:31.262187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c84aea26-5184-4216-8799-c0b1d697c3c1 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.224956 Jun 15 10:17:31.263013 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 291/577] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:31 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:31.912935 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:31.913587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:31.921868 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:31.922334 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:31.923850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:31.924453 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:32.073532 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:32.083048 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:32.084639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:32.085864 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-86fee309-e901-418c-953c-0e52289416f7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.178882 Jun 15 10:17:32.086465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 287/578] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:31 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:32.281119 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-203298d5-39ae-472c-9913-b7e57c79b5c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:32.282027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-203298d5-39ae-472c-9913-b7e57c79b5c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:32.291951 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-203298d5-39ae-472c-9913-b7e57c79b5c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:32.292948 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-203298d5-39ae-472c-9913-b7e57c79b5c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:32.293918 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-203298d5-39ae-472c-9913-b7e57c79b5c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:32.294676 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-203298d5-39ae-472c-9913-b7e57c79b5c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:32.306881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bb749d77-2a1d-4d6b-8fce-f9ed06ec41a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:32.307658 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bb749d77-2a1d-4d6b-8fce-f9ed06ec41a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:32.314238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb749d77-2a1d-4d6b-8fce-f9ed06ec41a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:32.314977 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb749d77-2a1d-4d6b-8fce-f9ed06ec41a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:32.316128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb749d77-2a1d-4d6b-8fce-f9ed06ec41a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:32.316947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb749d77-2a1d-4d6b-8fce-f9ed06ec41a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:32.348045 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bb749d77-2a1d-4d6b-8fce-f9ed06ec41a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:17:32.440094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bb749d77-2a1d-4d6b-8fce-f9ed06ec41a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "DELETE /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 204 len: 0 microversion: 2.1 time: 0.136617 Jun 15 10:17:32.445343 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 288/579] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:17:32 2022] DELETE /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:17:32.451533 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2abef735-dcca-4dca-8940-a32ccbb64929 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:32.452474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2abef735-dcca-4dca-8940-a32ccbb64929 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:32.460904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2abef735-dcca-4dca-8940-a32ccbb64929 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:32.461508 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2abef735-dcca-4dca-8940-a32ccbb64929 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:32.462434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2abef735-dcca-4dca-8940-a32ccbb64929 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:32.462970 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2abef735-dcca-4dca-8940-a32ccbb64929 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:32.510660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-203298d5-39ae-472c-9913-b7e57c79b5c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:32.520399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-203298d5-39ae-472c-9913-b7e57c79b5c9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.243624 Jun 15 10:17:32.521936 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 292/580] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:32 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:32.632846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2abef735-dcca-4dca-8940-a32ccbb64929 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:32.640948 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2abef735-dcca-4dca-8940-a32ccbb64929 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1513 microversion: 2.1 time: 0.194013 Jun 15 10:17:32.650307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 289/581] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:32 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:33.108169 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:33.109086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:33.118382 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:33.119131 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:33.120351 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:33.121090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:33.284184 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:33.293822 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:33.295491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:33.296693 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d5df519e-5607-4faa-8a6d-7ca7056db257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.194732 Jun 15 10:17:33.297283 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 293/582] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:33 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:33.548487 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a4fb1560-81d4-4d69-8b31-7cdaafa91fcc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:33.549782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a4fb1560-81d4-4d69-8b31-7cdaafa91fcc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:33.558910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a4fb1560-81d4-4d69-8b31-7cdaafa91fcc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:33.559974 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a4fb1560-81d4-4d69-8b31-7cdaafa91fcc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:33.560911 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a4fb1560-81d4-4d69-8b31-7cdaafa91fcc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:33.561376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a4fb1560-81d4-4d69-8b31-7cdaafa91fcc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:33.663573 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e2565cfa-aaa2-4a6b-90cf-a49f29581256 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:33.664206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e2565cfa-aaa2-4a6b-90cf-a49f29581256 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:33.671210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2565cfa-aaa2-4a6b-90cf-a49f29581256 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:33.671739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2565cfa-aaa2-4a6b-90cf-a49f29581256 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:33.672524 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2565cfa-aaa2-4a6b-90cf-a49f29581256 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:33.673176 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e2565cfa-aaa2-4a6b-90cf-a49f29581256 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:33.737111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a4fb1560-81d4-4d69-8b31-7cdaafa91fcc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:33.746209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a4fb1560-81d4-4d69-8b31-7cdaafa91fcc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.210646 Jun 15 10:17:33.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 290/583] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:33 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:33.845444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e2565cfa-aaa2-4a6b-90cf-a49f29581256 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:33.858717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e2565cfa-aaa2-4a6b-90cf-a49f29581256 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1513 microversion: 2.1 time: 0.200808 Jun 15 10:17:33.868786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 294/584] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:33 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:34.315296 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:34.321201 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:34.338975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:34.342960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:34.349913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:34.353252 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:34.528638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:34.537145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:34.538963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:34.540409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2d234ddc-f5d6-4add-a520-92afb8a5f5ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.229541 Jun 15 10:17:34.551382 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 291/585] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:34 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:34.764854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-afdee02f-bfdb-4f0d-aed5-34b461a24bc0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:34.765465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-afdee02f-bfdb-4f0d-aed5-34b461a24bc0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:34.773277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afdee02f-bfdb-4f0d-aed5-34b461a24bc0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:34.773723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afdee02f-bfdb-4f0d-aed5-34b461a24bc0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:34.774522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afdee02f-bfdb-4f0d-aed5-34b461a24bc0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:34.774964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afdee02f-bfdb-4f0d-aed5-34b461a24bc0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:34.880478 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1fd1bcdc-a7b5-47a1-957a-92ad4e8880c5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:34.881390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1fd1bcdc-a7b5-47a1-957a-92ad4e8880c5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:34.888284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fd1bcdc-a7b5-47a1-957a-92ad4e8880c5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:34.888948 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fd1bcdc-a7b5-47a1-957a-92ad4e8880c5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:34.889930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fd1bcdc-a7b5-47a1-957a-92ad4e8880c5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:34.890686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fd1bcdc-a7b5-47a1-957a-92ad4e8880c5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:34.924657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-afdee02f-bfdb-4f0d-aed5-34b461a24bc0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:34.932593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-afdee02f-bfdb-4f0d-aed5-34b461a24bc0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.171570 Jun 15 10:17:34.933404 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 295/586] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:34 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:35.066705 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1fd1bcdc-a7b5-47a1-957a-92ad4e8880c5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:35.074282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1fd1bcdc-a7b5-47a1-957a-92ad4e8880c5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1513 microversion: 2.1 time: 0.202375 Jun 15 10:17:35.074860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 292/587] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:34 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:35.558667 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:35.559478 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:35.566952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:35.567609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:35.568509 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:35.569457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:35.718650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:35.728177 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:35.730352 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:35.731835 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eacc4851-cc03-4324-96a1-a15207a64137 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.177366 Jun 15 10:17:35.732910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 296/588] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:35 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:35.952598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9df9ae74-f8d0-437d-8535-772f77a716b2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:35.953497 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9df9ae74-f8d0-437d-8535-772f77a716b2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:35.960448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9df9ae74-f8d0-437d-8535-772f77a716b2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:35.960902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9df9ae74-f8d0-437d-8535-772f77a716b2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:35.961675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9df9ae74-f8d0-437d-8535-772f77a716b2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:35.962113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9df9ae74-f8d0-437d-8535-772f77a716b2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:35.980630 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:36.092388 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8a96383d-dee1-4bd8-bf98-6af4283c5cc5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:36.093023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8a96383d-dee1-4bd8-bf98-6af4283c5cc5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:36.101141 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a96383d-dee1-4bd8-bf98-6af4283c5cc5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:36.102732 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a96383d-dee1-4bd8-bf98-6af4283c5cc5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:36.103698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a96383d-dee1-4bd8-bf98-6af4283c5cc5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:36.104547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8a96383d-dee1-4bd8-bf98-6af4283c5cc5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:36.142428 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9df9ae74-f8d0-437d-8535-772f77a716b2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:36.156877 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9df9ae74-f8d0-437d-8535-772f77a716b2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.208307 Jun 15 10:17:36.171625 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 293/589] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:35 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:36.266486 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8a96383d-dee1-4bd8-bf98-6af4283c5cc5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:36.279415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8a96383d-dee1-4bd8-bf98-6af4283c5cc5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1513 microversion: 2.1 time: 0.191174 Jun 15 10:17:36.280159 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 297/590] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:36 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:36.750872 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:36.751476 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:36.758030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:36.758505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:36.759265 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:36.759698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:36.908977 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:36.919012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:36.920805 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:36.921950 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6ac68413-a170-4645-82f9-6a7fbde516d4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.175000 Jun 15 10:17:36.922550 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 294/591] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:36 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:37.177731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-160d50fa-a052-4671-8e35-bf7227366642 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:37.178462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-160d50fa-a052-4671-8e35-bf7227366642 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:37.186647 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-160d50fa-a052-4671-8e35-bf7227366642 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:37.187126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-160d50fa-a052-4671-8e35-bf7227366642 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:37.187908 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-160d50fa-a052-4671-8e35-bf7227366642 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:37.188366 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-160d50fa-a052-4671-8e35-bf7227366642 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:37.297558 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-850a9bd8-f3ec-4a1a-9ea6-ac23bcfd818e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:37.298208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-850a9bd8-f3ec-4a1a-9ea6-ac23bcfd818e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:37.310651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-850a9bd8-f3ec-4a1a-9ea6-ac23bcfd818e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:37.311044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-850a9bd8-f3ec-4a1a-9ea6-ac23bcfd818e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:37.311855 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-850a9bd8-f3ec-4a1a-9ea6-ac23bcfd818e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:37.312292 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-850a9bd8-f3ec-4a1a-9ea6-ac23bcfd818e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:37.338701 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-160d50fa-a052-4671-8e35-bf7227366642 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:37.348228 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-160d50fa-a052-4671-8e35-bf7227366642 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.174169 Jun 15 10:17:37.358449 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 298/592] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:37 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:37.482759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-850a9bd8-f3ec-4a1a-9ea6-ac23bcfd818e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:37.491093 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-850a9bd8-f3ec-4a1a-9ea6-ac23bcfd818e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1513 microversion: 2.1 time: 0.197660 Jun 15 10:17:37.491922 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 295/593] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:37 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:37.942625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:37.943457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:37.955293 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:37.955738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:37.957152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:37.958023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:38.045983 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-10c474df-478e-4b03-9f50-26ab12168dc7 req-3ddace1b-b93c-4522-9df3-507d6e24d43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e", "name": "network-vif-deleted", "tag": "accef6ba-6969-4d7b-ada2-4cd9b23e6c8e"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:38.079684 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-10c474df-478e-4b03-9f50-26ab12168dc7 req-3ddace1b-b93c-4522-9df3-507d6e24d43e service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:38.081157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-10c474df-478e-4b03-9f50-26ab12168dc7 req-3ddace1b-b93c-4522-9df3-507d6e24d43e service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:38.097964 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-10c474df-478e-4b03-9f50-26ab12168dc7 req-3ddace1b-b93c-4522-9df3-507d6e24d43e service nova] Creating event network-vif-deleted:accef6ba-6969-4d7b-ada2-4cd9b23e6c8e for instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e on hv-cinder-83028 Jun 15 10:17:38.121758 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-10c474df-478e-4b03-9f50-26ab12168dc7 req-3ddace1b-b93c-4522-9df3-507d6e24d43e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076272 Jun 15 10:17:38.122040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 296/594] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:17:38.172799 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:38.187949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:38.194210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:38.194210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f8b32ec2-8186-40db-910e-427692c3aeb6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.255535 Jun 15 10:17:38.205361 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 299/595] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:37 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:38.366925 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4e717122-6d39-4fce-85b1-bcb67f531006 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:38.368777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4e717122-6d39-4fce-85b1-bcb67f531006 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:38.375885 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e717122-6d39-4fce-85b1-bcb67f531006 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:38.376356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e717122-6d39-4fce-85b1-bcb67f531006 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:38.377152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e717122-6d39-4fce-85b1-bcb67f531006 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:38.377587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e717122-6d39-4fce-85b1-bcb67f531006 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:38.509292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:38.510482 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:38.518090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:38.519733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:38.521122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:38.521728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:38.523783 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4e717122-6d39-4fce-85b1-bcb67f531006 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:38.540291 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4e717122-6d39-4fce-85b1-bcb67f531006 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.177445 Jun 15 10:17:38.541706 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 297/596] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:38 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:38.585262 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:38.586179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:38.586645 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lazy-loading 'fault' on Instance uuid 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:17:38.652456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:38.663939 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8d8dee56-4857-4dae-895e-13abd75d6abf tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 200 len: 1308 microversion: 2.1 time: 0.158588 Jun 15 10:17:38.665033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 300/597] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:38 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:39.214993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:39.215977 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:39.225233 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:39.226027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:39.228589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:39.229480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:39.444360 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:39.456057 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:39.458926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:39.460362 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3ed99766-6d89-49fb-b2e3-820bbc3da9e5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.250683 Jun 15 10:17:39.461131 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 298/598] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:39 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:39.561227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fbd57434-a61b-42a6-88ce-ef3814771289 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:39.561800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fbd57434-a61b-42a6-88ce-ef3814771289 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:39.568796 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fbd57434-a61b-42a6-88ce-ef3814771289 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:39.569457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fbd57434-a61b-42a6-88ce-ef3814771289 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:39.570441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fbd57434-a61b-42a6-88ce-ef3814771289 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:39.570880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fbd57434-a61b-42a6-88ce-ef3814771289 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:39.681769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:39.682719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:39.688690 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:39.689371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:39.690328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:39.691488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:39.706053 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] HTTP exception thrown: Instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e could not be found. Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Request method failure captured: Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e HTTP/1.1 Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbE_XdcNsdJjaf4xo-uK49qEs8Cy--_OoQMgDi5oSgJTkKZ-5epRb-ulbMSbkFintTVCGR2u-eFw0E9sNdROrAmlTg1FXQUpKvb_E4FJnyjXpdfDAaK1ST0vhdJlMldB-cXPolq4wse2S4TBKUjh5msgE5-qeK6D-J5shFVhB-P0j2o Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 6344b21c92314593b43addf9a8f21100 Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2073755291 Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:17:39.708875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6344b21c92314593b43addf9a8f21100", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6344b21c92314593b43addf9a8f21100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6344b21c92314593b43addf9a8f21100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6344b21c92314593b43addf9a8f21100"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-VolumesSnapshotTestJSON-2073755291 Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 6344b21c92314593b43addf9a8f21100 Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2073755291 Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-VolumesSnapshotTestJSON-2073755291-project Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 8c4fd4257ccd492a8ecf3dfb731cb142 Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-VolumesSnapshotTestJSON-2073755291-project Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e could not be found. Jun 15 10:17:39.710560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e'} Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e could not be found. Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:17:39.711348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e could not be found. Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e could not be found. Jun 15 10:17:39.712569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:17:39.715137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Returning 404 to user: Instance 630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:17:39.717172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9d7e2b40-d367-448b-8665-669d92742d8c tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e" status: 404 len: 111 microversion: 2.1 time: 0.039090 Jun 15 10:17:39.734331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 299/599] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:39 2022] GET /compute/v2.1/servers/630bb7a1-c0a7-43b0-91c5-a3725c7b3d4e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:17:39.736773 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fbd57434-a61b-42a6-88ce-ef3814771289 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:39.756338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fbd57434-a61b-42a6-88ce-ef3814771289 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.198746 Jun 15 10:17:39.764343 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 301/600] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:39 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:40.479426 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:40.480038 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:40.488293 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:40.489235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:40.490086 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:40.490746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:40.685068 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:40.693957 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:40.695541 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:40.696769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fad29ab4-511e-455a-8047-90961a803b31 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.221452 Jun 15 10:17:40.697629 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 300/601] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:40 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:40.777544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2fe9e326-50e2-46b8-a8d2-355732962484 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:40.779002 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2fe9e326-50e2-46b8-a8d2-355732962484 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:40.787565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fe9e326-50e2-46b8-a8d2-355732962484 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:40.788100 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fe9e326-50e2-46b8-a8d2-355732962484 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:40.789165 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fe9e326-50e2-46b8-a8d2-355732962484 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:40.789707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fe9e326-50e2-46b8-a8d2-355732962484 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:40.991342 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2fe9e326-50e2-46b8-a8d2-355732962484 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:41.005719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2fe9e326-50e2-46b8-a8d2-355732962484 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.231491 Jun 15 10:17:41.007517 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 302/602] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:40 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:17:41.719530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:41.720160 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:41.723637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:41.729780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:41.731377 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:41.732177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:41.732617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:41.895435 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:41.903857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:41.905397 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:41.906583 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1fc79ebe-eba4-4adf-8e9d-52b9af5df631 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.191000 Jun 15 10:17:41.907346 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 301/603] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:41 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:42.023558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a84b4d69-d799-4d76-9319-72bc66d3b57b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:42.024547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a84b4d69-d799-4d76-9319-72bc66d3b57b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:42.031275 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a84b4d69-d799-4d76-9319-72bc66d3b57b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:42.032090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a84b4d69-d799-4d76-9319-72bc66d3b57b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:42.033797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a84b4d69-d799-4d76-9319-72bc66d3b57b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:42.035086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a84b4d69-d799-4d76-9319-72bc66d3b57b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:42.192642 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a84b4d69-d799-4d76-9319-72bc66d3b57b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:42.204360 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a84b4d69-d799-4d76-9319-72bc66d3b57b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.184623 Jun 15 10:17:42.205514 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 303/604] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:42 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:42.926046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:42.926802 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:42.933552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:42.934011 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:42.934821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:42.935429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:43.080594 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:43.090996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:43.098613 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:43.099940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8180c758-36b2-4251-ae8a-ffe54b181b05 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.178578 Jun 15 10:17:43.100729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 302/605] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:42 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:43.222046 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8871c8ed-d1b5-4ea8-8592-5b0622ee347a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:43.223053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8871c8ed-d1b5-4ea8-8592-5b0622ee347a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:43.230094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8871c8ed-d1b5-4ea8-8592-5b0622ee347a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:43.230854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8871c8ed-d1b5-4ea8-8592-5b0622ee347a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:43.231827 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8871c8ed-d1b5-4ea8-8592-5b0622ee347a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:43.232264 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8871c8ed-d1b5-4ea8-8592-5b0622ee347a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:43.385536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8871c8ed-d1b5-4ea8-8592-5b0622ee347a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:43.395300 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8871c8ed-d1b5-4ea8-8592-5b0622ee347a tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.177075 Jun 15 10:17:43.402691 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 304/606] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:43 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:44.121909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:44.123103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:44.134759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:44.135594 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:44.136407 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:44.136946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:44.298703 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:44.307748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:44.309249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:44.310420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0bd175a6-dbce-41b4-992c-baac52f8d9d7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.194943 Jun 15 10:17:44.311144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 303/607] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:44 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:44.412269 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6a7259d2-049d-45e2-ac32-e219c6b1a8b8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:44.412889 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6a7259d2-049d-45e2-ac32-e219c6b1a8b8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:44.419673 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a7259d2-049d-45e2-ac32-e219c6b1a8b8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:44.420127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a7259d2-049d-45e2-ac32-e219c6b1a8b8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:44.420889 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a7259d2-049d-45e2-ac32-e219c6b1a8b8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:44.421317 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a7259d2-049d-45e2-ac32-e219c6b1a8b8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:44.578179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6a7259d2-049d-45e2-ac32-e219c6b1a8b8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:44.587605 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6a7259d2-049d-45e2-ac32-e219c6b1a8b8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.178991 Jun 15 10:17:44.588778 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 305/608] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:44 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:45.328904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:45.330204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:45.337602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:45.338426 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:45.339290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:45.339729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:45.487869 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:45.496770 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:45.498393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:45.499552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7f8ce05f-e652-41b4-b163-b46fdbbfa9a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.174757 Jun 15 10:17:45.500102 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 304/609] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:45 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:45.605916 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4f2ee9c2-b410-4ad6-883c-2ffe2de79177 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:45.607292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4f2ee9c2-b410-4ad6-883c-2ffe2de79177 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:45.614306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f2ee9c2-b410-4ad6-883c-2ffe2de79177 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:45.614728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f2ee9c2-b410-4ad6-883c-2ffe2de79177 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:45.615665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f2ee9c2-b410-4ad6-883c-2ffe2de79177 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:45.616292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f2ee9c2-b410-4ad6-883c-2ffe2de79177 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:45.657821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:45.802746 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4f2ee9c2-b410-4ad6-883c-2ffe2de79177 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:45.810511 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4f2ee9c2-b410-4ad6-883c-2ffe2de79177 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.208908 Jun 15 10:17:45.811325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 306/610] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:45 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:46.519092 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:46.519762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:46.526856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:46.527634 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:46.528700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:46.529172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:46.679209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:46.687459 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:46.689128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:46.690951 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5dad4784-395d-4762-a80d-39c564fc7d19 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.175910 Jun 15 10:17:46.691795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 305/611] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:46 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:46.828437 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-964c5115-f16a-49e1-898b-13cf95353e1f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:46.829127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-964c5115-f16a-49e1-898b-13cf95353e1f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:46.839399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-964c5115-f16a-49e1-898b-13cf95353e1f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:46.840315 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-964c5115-f16a-49e1-898b-13cf95353e1f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:46.841103 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-964c5115-f16a-49e1-898b-13cf95353e1f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:46.841706 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-964c5115-f16a-49e1-898b-13cf95353e1f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:46.993477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-964c5115-f16a-49e1-898b-13cf95353e1f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:47.005695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-964c5115-f16a-49e1-898b-13cf95353e1f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.181098 Jun 15 10:17:47.006805 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 307/612] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:46 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:47.710078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:47.710710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:47.716707 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:47.717104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:47.717844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:47.718292 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:47.849385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:47.857359 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:47.858886 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:47.860025 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5b2cc263-0048-47ce-8f14-ac1c170811ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.154335 Jun 15 10:17:47.860577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 306/613] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:47 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:48.022769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5efc4f17-fd2b-4044-882c-f0399ddbe890 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:48.023382 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5efc4f17-fd2b-4044-882c-f0399ddbe890 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:48.029781 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5efc4f17-fd2b-4044-882c-f0399ddbe890 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:48.030227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5efc4f17-fd2b-4044-882c-f0399ddbe890 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:48.031016 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5efc4f17-fd2b-4044-882c-f0399ddbe890 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:48.031451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5efc4f17-fd2b-4044-882c-f0399ddbe890 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:48.162113 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5efc4f17-fd2b-4044-882c-f0399ddbe890 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:48.169573 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5efc4f17-fd2b-4044-882c-f0399ddbe890 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.150661 Jun 15 10:17:48.170144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 308/614] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:48 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:48.880134 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:48.881464 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:48.888723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:48.889177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:48.889990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:48.890565 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:49.036975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:49.045959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:49.047970 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:49.049447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-161e8651-f326-40d1-9af0-c5b08550a10f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.175414 Jun 15 10:17:49.050233 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 307/615] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:48 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:49.187295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-432860c9-7cb5-412a-93f8-eff08af950c0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:49.188616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-432860c9-7cb5-412a-93f8-eff08af950c0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:49.196118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-432860c9-7cb5-412a-93f8-eff08af950c0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:49.196683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-432860c9-7cb5-412a-93f8-eff08af950c0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:49.197548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-432860c9-7cb5-412a-93f8-eff08af950c0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:49.198096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-432860c9-7cb5-412a-93f8-eff08af950c0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:49.345712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-432860c9-7cb5-412a-93f8-eff08af950c0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:49.354631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-432860c9-7cb5-412a-93f8-eff08af950c0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.171463 Jun 15 10:17:49.355454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 309/616] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:49 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:50.071358 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:50.072698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:50.079513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:50.079967 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:50.080765 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:50.081227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:50.233323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:50.241340 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:50.242867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:50.244018 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-502dd5ee-1fe1-4898-b03a-415d7addf69a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.178415 Jun 15 10:17:50.245060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 308/617] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:50 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:50.372807 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-33ecce9f-8822-454b-b8b3-c78b5e8311d5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:50.373624 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-33ecce9f-8822-454b-b8b3-c78b5e8311d5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:50.381707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-33ecce9f-8822-454b-b8b3-c78b5e8311d5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:50.382309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-33ecce9f-8822-454b-b8b3-c78b5e8311d5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:50.383230 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-33ecce9f-8822-454b-b8b3-c78b5e8311d5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:50.383948 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-33ecce9f-8822-454b-b8b3-c78b5e8311d5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:50.547107 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-33ecce9f-8822-454b-b8b3-c78b5e8311d5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:50.556558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-33ecce9f-8822-454b-b8b3-c78b5e8311d5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.187982 Jun 15 10:17:50.567413 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 310/618] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:50 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:50.783670 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-62c7e58a-c431-4903-b71a-8638ab1420bc req-a6ca2cb4-9b2a-4e7c-8178-d9f0870326a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017fbaea-de4e-4981-b1a7-f85fc6d5fc74", "name": "network-vif-plugged", "status": "completed", "tag": "a0d42ef5-c08b-4c5d-807e-fde0e4998fd2"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:50.793039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-62c7e58a-c431-4903-b71a-8638ab1420bc req-a6ca2cb4-9b2a-4e7c-8178-d9f0870326a8 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:50.793213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-62c7e58a-c431-4903-b71a-8638ab1420bc req-a6ca2cb4-9b2a-4e7c-8178-d9f0870326a8 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:50.805401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-62c7e58a-c431-4903-b71a-8638ab1420bc req-a6ca2cb4-9b2a-4e7c-8178-d9f0870326a8 service nova] Creating event network-vif-plugged:a0d42ef5-c08b-4c5d-807e-fde0e4998fd2 for instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 on hv-cinder-83028 Jun 15 10:17:50.810315 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-62c7e58a-c431-4903-b71a-8638ab1420bc req-a6ca2cb4-9b2a-4e7c-8178-d9f0870326a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030447 Jun 15 10:17:50.810908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 309/619] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:17:51.262986 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:51.263586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:51.270133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:51.270607 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:51.271373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:51.271813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:51.401183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:51.409040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:51.410714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:51.411853 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e0792f17-67da-492d-87df-ce43243029fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.152871 Jun 15 10:17:51.412418 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 311/620] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:51 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:51.574416 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d499a343-a982-4b7e-a86c-9e8abebdb440 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:51.575151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d499a343-a982-4b7e-a86c-9e8abebdb440 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:51.581576 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d499a343-a982-4b7e-a86c-9e8abebdb440 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:51.582880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d499a343-a982-4b7e-a86c-9e8abebdb440 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:51.583731 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d499a343-a982-4b7e-a86c-9e8abebdb440 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:51.584167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d499a343-a982-4b7e-a86c-9e8abebdb440 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:51.730423 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d499a343-a982-4b7e-a86c-9e8abebdb440 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:51.739336 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d499a343-a982-4b7e-a86c-9e8abebdb440 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.169464 Jun 15 10:17:51.739935 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 310/621] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:51 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:52.429757 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:52.430343 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:52.436829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:52.437280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:52.438041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:52.438509 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:52.572179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:52.580070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:52.581587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:52.582933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-70fc91c2-4ad9-4414-baa2-b8d59f32587d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.157341 Jun 15 10:17:52.583529 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 312/622] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:52 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:52.756930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6ec62c5e-54e0-46f1-963e-4e867912cac4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:52.757488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6ec62c5e-54e0-46f1-963e-4e867912cac4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:52.764180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ec62c5e-54e0-46f1-963e-4e867912cac4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:52.764623 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ec62c5e-54e0-46f1-963e-4e867912cac4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:52.765388 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ec62c5e-54e0-46f1-963e-4e867912cac4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:52.765819 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6ec62c5e-54e0-46f1-963e-4e867912cac4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:52.901634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-1e7ea16b-352e-4acb-8f4b-90a80ff5d641 req-94f1d45c-c033-46ad-bc55-482da0af5bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5ab626-a7eb-407e-b8a9-a768e57d4022", "name": "network-vif-plugged", "status": "completed", "tag": "2021b47d-9010-4d70-8020-0269285a0559"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:52.908402 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6ec62c5e-54e0-46f1-963e-4e867912cac4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:52.911173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-1e7ea16b-352e-4acb-8f4b-90a80ff5d641 req-94f1d45c-c033-46ad-bc55-482da0af5bdd service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:52.911650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-1e7ea16b-352e-4acb-8f4b-90a80ff5d641 req-94f1d45c-c033-46ad-bc55-482da0af5bdd service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:52.918774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6ec62c5e-54e0-46f1-963e-4e867912cac4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.166398 Jun 15 10:17:52.919775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 311/623] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:52 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:52.923077 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-1e7ea16b-352e-4acb-8f4b-90a80ff5d641 req-94f1d45c-c033-46ad-bc55-482da0af5bdd service nova] Creating event network-vif-plugged:2021b47d-9010-4d70-8020-0269285a0559 for instance af5ab626-a7eb-407e-b8a9-a768e57d4022 on hv-cinder-83028 Jun 15 10:17:52.932602 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-1e7ea16b-352e-4acb-8f4b-90a80ff5d641 req-94f1d45c-c033-46ad-bc55-482da0af5bdd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034746 Jun 15 10:17:52.933208 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 313/624] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:17:53.601772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:53.602401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:53.609197 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:53.609674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:53.610507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:53.610999 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:53.614115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:53.742789 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:53.750563 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:53.752075 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:53.753246 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-24aa205f-7775-4493-adb9-f2dd77daa751 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.156235 Jun 15 10:17:53.754854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 312/625] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:53 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:53.938845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8b952a41-1c31-40d9-9a9f-69d1a0a6aeea tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:53.939539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8b952a41-1c31-40d9-9a9f-69d1a0a6aeea tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:53.946260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b952a41-1c31-40d9-9a9f-69d1a0a6aeea tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:53.946733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b952a41-1c31-40d9-9a9f-69d1a0a6aeea tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:53.947480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b952a41-1c31-40d9-9a9f-69d1a0a6aeea tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:53.947910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b952a41-1c31-40d9-9a9f-69d1a0a6aeea tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:54.084573 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8b952a41-1c31-40d9-9a9f-69d1a0a6aeea tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:54.092207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8b952a41-1c31-40d9-9a9f-69d1a0a6aeea tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.158043 Jun 15 10:17:54.092787 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 314/626] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:53 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:54.772050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:54.772640 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:54.779157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:54.779606 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:54.780360 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:54.780791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:54.915715 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:54.923602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:54.925115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:54.926632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8123af17-479e-4ef1-9ee7-668d228ae94a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.158922 Jun 15 10:17:54.927191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 313/627] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:54 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:55.109270 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-831347aa-4458-4caa-b04f-f13c572fc39f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:55.109831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-831347aa-4458-4caa-b04f-f13c572fc39f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:55.116359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-831347aa-4458-4caa-b04f-f13c572fc39f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:55.116813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-831347aa-4458-4caa-b04f-f13c572fc39f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:55.117593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-831347aa-4458-4caa-b04f-f13c572fc39f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:55.118037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-831347aa-4458-4caa-b04f-f13c572fc39f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:55.248446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-831347aa-4458-4caa-b04f-f13c572fc39f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:55.260286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-831347aa-4458-4caa-b04f-f13c572fc39f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.154969 Jun 15 10:17:55.260872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 315/628] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:55 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:55.944572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:55.945220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:55.951730 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:55.952181 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:55.952944 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:55.953385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:56.086464 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:56.094218 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:56.095739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:56.097369 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f340ed76-1cda-41a1-8325-d094d1162a7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.156256 Jun 15 10:17:56.097926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 314/629] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:55 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:56.279367 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f55b5db3-f617-4549-8b30-43c2ef30c991 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:56.280110 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f55b5db3-f617-4549-8b30-43c2ef30c991 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:56.289678 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f55b5db3-f617-4549-8b30-43c2ef30c991 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:56.290130 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f55b5db3-f617-4549-8b30-43c2ef30c991 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:56.290937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f55b5db3-f617-4549-8b30-43c2ef30c991 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:56.291384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f55b5db3-f617-4549-8b30-43c2ef30c991 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:56.430080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f55b5db3-f617-4549-8b30-43c2ef30c991 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:56.437439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f55b5db3-f617-4549-8b30-43c2ef30c991 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1258 microversion: 2.1 time: 0.162783 Jun 15 10:17:56.437943 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 316/630] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:56 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:57.118022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:57.118415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:57.126569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:57.127392 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:57.129474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:57.129923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:57.262397 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:57.273340 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:57.274877 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:57.276046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c9507732-3750-489b-a24c-7432b37aa7cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1743 microversion: 2.20 time: 0.164557 Jun 15 10:17:57.276624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 315/631] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:57 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:57.453699 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-743b6b5f-ef76-4b20-9871-b058e5f92ebd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:57.454440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-743b6b5f-ef76-4b20-9871-b058e5f92ebd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:57.461227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-743b6b5f-ef76-4b20-9871-b058e5f92ebd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:57.461746 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-743b6b5f-ef76-4b20-9871-b058e5f92ebd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:57.462596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-743b6b5f-ef76-4b20-9871-b058e5f92ebd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:57.463096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-743b6b5f-ef76-4b20-9871-b058e5f92ebd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:57.673700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-743b6b5f-ef76-4b20-9871-b058e5f92ebd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:57.681952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-743b6b5f-ef76-4b20-9871-b058e5f92ebd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1441 microversion: 2.1 time: 0.232034 Jun 15 10:17:57.682558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 317/632] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:57 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1441 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:57.698671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4a5a441d-5f17-404a-bca7-21942bbe4d46 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:57.699468 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4a5a441d-5f17-404a-bca7-21942bbe4d46 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:57.705814 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a5a441d-5f17-404a-bca7-21942bbe4d46 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:57.706382 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a5a441d-5f17-404a-bca7-21942bbe4d46 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:57.707343 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a5a441d-5f17-404a-bca7-21942bbe4d46 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:57.707790 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a5a441d-5f17-404a-bca7-21942bbe4d46 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:57.930695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4a5a441d-5f17-404a-bca7-21942bbe4d46 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:57.942203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4a5a441d-5f17-404a-bca7-21942bbe4d46 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1441 microversion: 2.1 time: 0.246376 Jun 15 10:17:57.942834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 316/633] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:57 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1441 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:58.123556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1329417699", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "networks": [{"uuid": "fcc15d63-bcf1-4fa7-8d0e-6837e0713812"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:58.196276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] validate_networks() for [('fcc15d63-bcf1-4fa7-8d0e-6837e0713812', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:17:58.315979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:58.317552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:58.333277 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:58.333991 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:58.335101 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:58.335837 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:58.687864 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:58.708072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:58.721600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:58.726784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-48b2fb24-071b-4640-a030-f709c3b6bd9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.431320 Jun 15 10:17:58.731567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 317/634] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:58 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:17:58.964120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:17:58.965117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:17:58.965804 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:17:58.967139 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:17:58.967745 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:17:58.970728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=62 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:17:58.989668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:58.990453 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:58.991429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:58.992316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:59.022015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Getting quotas for project 6344b21c92314593b43addf9a8f21100. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:17:59.027502 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Getting quotas for user 8c4fd4257ccd492a8ecf3dfb731cb142 and project 6344b21c92314593b43addf9a8f21100. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:17:59.043995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:17:59.047533 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:17:59.124493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2a3ac398-2b15-4c14-a505-7805afe97f47 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004687 Jun 15 10:17:59.126637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 318/635] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:17:59.135761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c7f375f5-0ddb-48b3-8f07-ac278a7d42dc tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:59.136520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c7f375f5-0ddb-48b3-8f07-ac278a7d42dc tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:59.231891 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c7f375f5-0ddb-48b3-8f07-ac278a7d42dc tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:17:59.245624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c7f375f5-0ddb-48b3-8f07-ac278a7d42dc tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1219 microversion: 2.1 time: 0.113692 Jun 15 10:17:59.246582 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 318/636] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:17:59 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:17:59.740408 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1259293270", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-552614952", "security_groups": [{"name": "tempest-secgroup-smoke-132408903"}], "block_device_mapping_v2": [{"uuid": "1642aa75-3ff7-4ddf-83fc-b9826b0c80a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82fdb04b-f19e-4e9e-88bc-bf5a50bb7342"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:17:59.760238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:17:59.761469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:17:59.774258 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:59.774914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:17:59.775851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:17:59.776449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:00.022082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] validate_networks() for [('82fdb04b-f19e-4e9e-88bc-bf5a50bb7342', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:18:00.081082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:00.102448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:00.110077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:00.114107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-17a849d0-f2a1-4158-b113-e13ba1a520de tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.357720 Jun 15 10:18:00.117543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 319/637] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:17:59 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:18:00.267953 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-caeb5623-e6a4-4a86-9704-ffa2cdf8680b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:00.276204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-caeb5623-e6a4-4a86-9704-ffa2cdf8680b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:00.302157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-caeb5623-e6a4-4a86-9704-ffa2cdf8680b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:00.303114 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-caeb5623-e6a4-4a86-9704-ffa2cdf8680b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:00.304278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-caeb5623-e6a4-4a86-9704-ffa2cdf8680b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:00.304990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-caeb5623-e6a4-4a86-9704-ffa2cdf8680b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:00.407324 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-caeb5623-e6a4-4a86-9704-ffa2cdf8680b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:00.422168 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-caeb5623-e6a4-4a86-9704-ffa2cdf8680b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1271 microversion: 2.1 time: 0.160016 Jun 15 10:18:00.423165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 320/638] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:00 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:00.701977 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:18:00.702585 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:18:00.703719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:18:00.703719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:18:00.704377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:18:00.719265 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:00.721103 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:00.723060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:00.723891 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:00.750163 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Getting quotas for project c6cf56db2b454c688b9305ef587f407e. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:18:00.755468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Getting quotas for user 9ee3b5927ffa4ef5b7f617073e083a80 and project c6cf56db2b454c688b9305ef587f407e. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:18:00.847698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:18:00.850454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1642aa75-3ff7-4ddf-83fc-b9826b0c80a6',volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:18:01.058566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a2ff00d7-3ab6-46f4-968b-d0f1d359ce3f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.322948 Jun 15 10:18:01.059726 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 319/639] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:17:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:18:01.071387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-742ed594-2715-452d-898f-08f77abc590a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:01.072124 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-742ed594-2715-452d-898f-08f77abc590a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:01.136744 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:01.139778 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:01.158492 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:01.160396 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:01.163090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:01.164459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:01.192625 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-742ed594-2715-452d-898f-08f77abc590a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:01.201026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-742ed594-2715-452d-898f-08f77abc590a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1094 microversion: 2.1 time: 0.135450 Jun 15 10:18:01.216430 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 321/640] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:01 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1094 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:01.379957 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:01.388469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:01.389987 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:01.391178 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e9519b5b-3569-4de6-b098-b34fb02fd264 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.260177 Jun 15 10:18:01.404697 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 320/641] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:01 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:01.444812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fe4979ae-8907-4cc6-91b6-20f379155c98 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:01.447080 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fe4979ae-8907-4cc6-91b6-20f379155c98 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:01.462433 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fe4979ae-8907-4cc6-91b6-20f379155c98 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:01.463552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fe4979ae-8907-4cc6-91b6-20f379155c98 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:01.464630 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fe4979ae-8907-4cc6-91b6-20f379155c98 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:01.465305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fe4979ae-8907-4cc6-91b6-20f379155c98 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:01.587072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fe4979ae-8907-4cc6-91b6-20f379155c98 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:01.596235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fe4979ae-8907-4cc6-91b6-20f379155c98 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1277 microversion: 2.1 time: 0.158872 Jun 15 10:18:01.597686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 322/642] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:01 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:01.812753 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3ae5cf21-4322-4e8e-9a87-0e38977c081b req-2fc0a8d6-699e-4303-a3ab-27b2ea2dfaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017fbaea-de4e-4981-b1a7-f85fc6d5fc74", "tag": "a0d42ef5-c08b-4c5d-807e-fde0e4998fd2"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:01.831550 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3ae5cf21-4322-4e8e-9a87-0e38977c081b req-2fc0a8d6-699e-4303-a3ab-27b2ea2dfaa4 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:01.831996 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3ae5cf21-4322-4e8e-9a87-0e38977c081b req-2fc0a8d6-699e-4303-a3ab-27b2ea2dfaa4 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:01.859206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3ae5cf21-4322-4e8e-9a87-0e38977c081b req-2fc0a8d6-699e-4303-a3ab-27b2ea2dfaa4 service nova] Creating event network-changed:a0d42ef5-c08b-4c5d-807e-fde0e4998fd2 for instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 on hv-cinder-83028 Jun 15 10:18:01.868519 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3ae5cf21-4322-4e8e-9a87-0e38977c081b req-2fc0a8d6-699e-4303-a3ab-27b2ea2dfaa4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059476 Jun 15 10:18:01.869396 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 321/643] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:18:02.217190 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2fb5fb54-8528-406a-ae9b-b5678d496b43 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:02.217813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2fb5fb54-8528-406a-ae9b-b5678d496b43 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:02.230337 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2fb5fb54-8528-406a-ae9b-b5678d496b43 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:02.230793 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2fb5fb54-8528-406a-ae9b-b5678d496b43 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:02.231573 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2fb5fb54-8528-406a-ae9b-b5678d496b43 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:02.232009 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2fb5fb54-8528-406a-ae9b-b5678d496b43 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:02.411655 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:02.415083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:02.449303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:02.450812 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:02.452381 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:02.459191 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:02.462228 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2fb5fb54-8528-406a-ae9b-b5678d496b43 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:02.480002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2fb5fb54-8528-406a-ae9b-b5678d496b43 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1136 microversion: 2.1 time: 0.264873 Jun 15 10:18:02.493111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 323/644] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:02 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1136 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:02.615959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2d419361-255d-4893-96ea-2108ccd97a8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:02.616827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2d419361-255d-4893-96ea-2108ccd97a8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:02.632714 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d419361-255d-4893-96ea-2108ccd97a8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:02.638476 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d419361-255d-4893-96ea-2108ccd97a8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:02.639767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d419361-255d-4893-96ea-2108ccd97a8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:02.640375 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2d419361-255d-4893-96ea-2108ccd97a8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:02.689399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:02.704211 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:02.706309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:02.707774 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eabb6c74-8c47-48fe-8cd3-696a9a559bb2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.302489 Jun 15 10:18:02.719111 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 322/645] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:02 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:18:02.900800 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2d419361-255d-4893-96ea-2108ccd97a8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:02.910909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2d419361-255d-4893-96ea-2108ccd97a8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.299914 Jun 15 10:18:02.922838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 324/646] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:02 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:03.503071 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d478e717-b7cf-43cc-8a8b-8c53f05eade3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:03.505461 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d478e717-b7cf-43cc-8a8b-8c53f05eade3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:03.518545 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d478e717-b7cf-43cc-8a8b-8c53f05eade3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:03.519120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d478e717-b7cf-43cc-8a8b-8c53f05eade3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:03.520127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d478e717-b7cf-43cc-8a8b-8c53f05eade3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:03.520696 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d478e717-b7cf-43cc-8a8b-8c53f05eade3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:03.647501 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d478e717-b7cf-43cc-8a8b-8c53f05eade3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:03.657403 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d478e717-b7cf-43cc-8a8b-8c53f05eade3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1210 microversion: 2.1 time: 0.162829 Jun 15 10:18:03.670199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 323/647] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:03 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1210 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:03.733765 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:03.735216 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:03.744520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:03.745141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:03.746113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:03.746698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:03.939645 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a162475f-767b-45d9-adcd-0848cbc0d2d5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:03.941953 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a162475f-767b-45d9-adcd-0848cbc0d2d5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:03.949069 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a162475f-767b-45d9-adcd-0848cbc0d2d5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:03.950386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a162475f-767b-45d9-adcd-0848cbc0d2d5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:03.951582 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a162475f-767b-45d9-adcd-0848cbc0d2d5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:03.952769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a162475f-767b-45d9-adcd-0848cbc0d2d5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:04.089729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:04.121535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:04.130208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:04.136957 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e6bbe819-391d-4354-8a44-660b32e1ad8b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.413890 Jun 15 10:18:04.139503 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 325/648] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:03 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:04.153905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-3b975f87-f3c8-4824-8003-d4d098d4e054 req-274cee1a-6b8e-4e7e-94ed-bc78ab111ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf752fce-11a0-452b-8a60-58506c708350", "tag": "7b5afd89-cb94-42ce-b94a-3ebec914a616"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:04.169140 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3b975f87-f3c8-4824-8003-d4d098d4e054 req-274cee1a-6b8e-4e7e-94ed-bc78ab111ad6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:04.170318 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3b975f87-f3c8-4824-8003-d4d098d4e054 req-274cee1a-6b8e-4e7e-94ed-bc78ab111ad6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:04.191665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-3b975f87-f3c8-4824-8003-d4d098d4e054 req-274cee1a-6b8e-4e7e-94ed-bc78ab111ad6 service nova] Creating event network-changed:7b5afd89-cb94-42ce-b94a-3ebec914a616 for instance bf752fce-11a0-452b-8a60-58506c708350 on hv-cinder-83028 Jun 15 10:18:04.201042 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-3b975f87-f3c8-4824-8003-d4d098d4e054 req-274cee1a-6b8e-4e7e-94ed-bc78ab111ad6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053594 Jun 15 10:18:04.202850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 326/649] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:18:04.221968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a162475f-767b-45d9-adcd-0848cbc0d2d5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:04.238543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a162475f-767b-45d9-adcd-0848cbc0d2d5 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.301418 Jun 15 10:18:04.248163 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 324/650] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:03 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:04.677475 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fc51717d-0f58-4428-a46f-2813cc669bbe tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:04.678192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fc51717d-0f58-4428-a46f-2813cc669bbe tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:04.700804 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc51717d-0f58-4428-a46f-2813cc669bbe tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:04.701256 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc51717d-0f58-4428-a46f-2813cc669bbe tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:04.703131 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc51717d-0f58-4428-a46f-2813cc669bbe tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:04.703726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fc51717d-0f58-4428-a46f-2813cc669bbe tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:05.036613 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fc51717d-0f58-4428-a46f-2813cc669bbe tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:05.055618 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fc51717d-0f58-4428-a46f-2813cc669bbe tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.372736 Jun 15 10:18:05.056644 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 327/651] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:04 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:05.168979 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:05.169644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:05.180799 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:05.181856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:05.182669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:05.183647 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:05.209762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:05.270567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ddee4f35-c3b3-4828-a41f-29a53efd6a89 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:05.272921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ddee4f35-c3b3-4828-a41f-29a53efd6a89 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:05.307812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ddee4f35-c3b3-4828-a41f-29a53efd6a89 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:05.308724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ddee4f35-c3b3-4828-a41f-29a53efd6a89 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:05.313678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ddee4f35-c3b3-4828-a41f-29a53efd6a89 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:05.316528 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ddee4f35-c3b3-4828-a41f-29a53efd6a89 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:05.597415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:05.614219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:05.615783 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:05.616970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1dbe7a70-789b-42fb-bc7d-06c1c8e30ded tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.451866 Jun 15 10:18:05.623704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 325/652] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:05 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:05.687413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ddee4f35-c3b3-4828-a41f-29a53efd6a89 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:05.695507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ddee4f35-c3b3-4828-a41f-29a53efd6a89 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.435173 Jun 15 10:18:05.704835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 328/653] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:05 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:05.795847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-f29e5e03-ffce-4a8d-bd92-78ebd7896671 req-0b3e222b-7151-4d85-9257-b3d0224cca66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2b6202-44f6-40f9-849b-5803d6bc4804", "tag": "50a683de-f892-4296-bd13-128af91a8b71"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:05.806004 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f29e5e03-ffce-4a8d-bd92-78ebd7896671 req-0b3e222b-7151-4d85-9257-b3d0224cca66 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:05.806754 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-f29e5e03-ffce-4a8d-bd92-78ebd7896671 req-0b3e222b-7151-4d85-9257-b3d0224cca66 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:05.832737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-f29e5e03-ffce-4a8d-bd92-78ebd7896671 req-0b3e222b-7151-4d85-9257-b3d0224cca66 service nova] Creating event network-changed:50a683de-f892-4296-bd13-128af91a8b71 for instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 on hv-cinder-83028 Jun 15 10:18:05.841480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-f29e5e03-ffce-4a8d-bd92-78ebd7896671 req-0b3e222b-7151-4d85-9257-b3d0224cca66 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048398 Jun 15 10:18:05.847281 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 326/654] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:18:06.074852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-108a5666-02cd-4f8d-9e93-6c11a623ac87 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:06.076050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-108a5666-02cd-4f8d-9e93-6c11a623ac87 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:06.083548 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-108a5666-02cd-4f8d-9e93-6c11a623ac87 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:06.084192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-108a5666-02cd-4f8d-9e93-6c11a623ac87 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:06.085010 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-108a5666-02cd-4f8d-9e93-6c11a623ac87 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:06.085494 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-108a5666-02cd-4f8d-9e93-6c11a623ac87 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:06.229224 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-108a5666-02cd-4f8d-9e93-6c11a623ac87 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:06.237117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-108a5666-02cd-4f8d-9e93-6c11a623ac87 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.166322 Jun 15 10:18:06.237652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 329/655] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:06 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:06.641467 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:06.646550 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:06.655054 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:06.655672 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:06.656603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:06.657162 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:06.712037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1062c1e5-daeb-43d4-b74d-8e04d7752ea4 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:06.712889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1062c1e5-daeb-43d4-b74d-8e04d7752ea4 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:06.719584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1062c1e5-daeb-43d4-b74d-8e04d7752ea4 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:06.720261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1062c1e5-daeb-43d4-b74d-8e04d7752ea4 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:06.722103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1062c1e5-daeb-43d4-b74d-8e04d7752ea4 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:06.722795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1062c1e5-daeb-43d4-b74d-8e04d7752ea4 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:06.926660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:06.937480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:06.940314 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:06.941745 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-93c8c367-f6c9-4936-aa46-f65a82fbffdb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.309994 Jun 15 10:18:06.950337 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 327/656] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:06 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:06.950713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1062c1e5-daeb-43d4-b74d-8e04d7752ea4 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:06.960210 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1062c1e5-daeb-43d4-b74d-8e04d7752ea4 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.251940 Jun 15 10:18:06.961403 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 330/657] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:06 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:07.255285 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e3adf72c-039f-4e92-b386-f7dff0c68f6b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:07.256301 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e3adf72c-039f-4e92-b386-f7dff0c68f6b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:07.262491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3adf72c-039f-4e92-b386-f7dff0c68f6b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:07.262944 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3adf72c-039f-4e92-b386-f7dff0c68f6b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:07.263713 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3adf72c-039f-4e92-b386-f7dff0c68f6b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:07.264195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3adf72c-039f-4e92-b386-f7dff0c68f6b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:07.402085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e3adf72c-039f-4e92-b386-f7dff0c68f6b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:07.409970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e3adf72c-039f-4e92-b386-f7dff0c68f6b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.159518 Jun 15 10:18:07.410762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 328/658] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:07 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:07.960395 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:07.961005 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:07.969225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:07.969676 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:07.970481 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:07.970914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:07.980181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1cd0de5b-9827-498c-bc9b-e471e9efb21d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:07.981926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1cd0de5b-9827-498c-bc9b-e471e9efb21d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:07.988307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:07.993768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1cd0de5b-9827-498c-bc9b-e471e9efb21d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:07.994498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1cd0de5b-9827-498c-bc9b-e471e9efb21d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:07.995558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1cd0de5b-9827-498c-bc9b-e471e9efb21d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:07.996254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1cd0de5b-9827-498c-bc9b-e471e9efb21d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:08.204665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:08.214586 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:08.216191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:08.217359 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a8fd49be-bf06-43c8-85dd-8b048b182caf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.261013 Jun 15 10:18:08.218485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 331/659] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:07 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:08.247130 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1cd0de5b-9827-498c-bc9b-e471e9efb21d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:08.256293 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1cd0de5b-9827-498c-bc9b-e471e9efb21d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.282398 Jun 15 10:18:08.256874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 329/660] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:07 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:08.428110 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a78cc29b-6443-4fbe-938a-1c8ba8a335c3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:08.428831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a78cc29b-6443-4fbe-938a-1c8ba8a335c3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:08.435260 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a78cc29b-6443-4fbe-938a-1c8ba8a335c3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:08.436453 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a78cc29b-6443-4fbe-938a-1c8ba8a335c3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:08.437723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a78cc29b-6443-4fbe-938a-1c8ba8a335c3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:08.438020 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a78cc29b-6443-4fbe-938a-1c8ba8a335c3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:08.678504 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a78cc29b-6443-4fbe-938a-1c8ba8a335c3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:08.688920 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a78cc29b-6443-4fbe-938a-1c8ba8a335c3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.265891 Jun 15 10:18:08.690163 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 332/661] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:08 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:09.237998 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:09.238786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:09.251338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:09.262021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:09.263089 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:09.263545 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:09.275090 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4fc62105-5423-4b54-b4a3-99ac5856a928 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:09.276281 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4fc62105-5423-4b54-b4a3-99ac5856a928 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:09.294412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4fc62105-5423-4b54-b4a3-99ac5856a928 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:09.295429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4fc62105-5423-4b54-b4a3-99ac5856a928 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:09.296463 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4fc62105-5423-4b54-b4a3-99ac5856a928 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:09.297124 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4fc62105-5423-4b54-b4a3-99ac5856a928 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:09.508033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:09.522804 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:09.526599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:09.530082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d84031f9-11dc-4d40-89eb-305479a0d4df tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.296671 Jun 15 10:18:09.543265 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 330/662] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:09 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:09.600698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4fc62105-5423-4b54-b4a3-99ac5856a928 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:09.608663 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4fc62105-5423-4b54-b4a3-99ac5856a928 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.338196 Jun 15 10:18:09.609236 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 333/663] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:09 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:09.704890 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8449c916-9641-4c36-bccf-f4d293e211b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:09.706174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8449c916-9641-4c36-bccf-f4d293e211b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:09.713180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8449c916-9641-4c36-bccf-f4d293e211b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:09.713940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8449c916-9641-4c36-bccf-f4d293e211b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:09.715197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8449c916-9641-4c36-bccf-f4d293e211b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:09.715985 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8449c916-9641-4c36-bccf-f4d293e211b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:09.905434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8449c916-9641-4c36-bccf-f4d293e211b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:09.918084 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8449c916-9641-4c36-bccf-f4d293e211b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.216828 Jun 15 10:18:09.924842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 331/664] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:09 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:10.552921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:10.554611 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:10.574014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:10.574531 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:10.575371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:10.576372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:10.625096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-79365f20-cb16-4dfa-a61d-804ec70bb9b6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:10.626405 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-79365f20-cb16-4dfa-a61d-804ec70bb9b6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:10.649520 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-79365f20-cb16-4dfa-a61d-804ec70bb9b6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:10.662777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-79365f20-cb16-4dfa-a61d-804ec70bb9b6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:10.663914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-79365f20-cb16-4dfa-a61d-804ec70bb9b6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:10.665113 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-79365f20-cb16-4dfa-a61d-804ec70bb9b6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:10.740738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=4 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:10.764726 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=12 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:10.769135 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:10.783308 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:10.785153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:10.789418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-00a79b56-5deb-4068-a34f-31e1e167a9d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.240818 Jun 15 10:18:10.793123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 334/665] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:10 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:10.905583 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-79365f20-cb16-4dfa-a61d-804ec70bb9b6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:10.917771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-79365f20-cb16-4dfa-a61d-804ec70bb9b6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.296634 Jun 15 10:18:10.918782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 332/666] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:10 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:10.934748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-37d53056-8f44-4f2f-a7a4-f1fea5e394ea tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:10.935356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-37d53056-8f44-4f2f-a7a4-f1fea5e394ea tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:10.942316 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-37d53056-8f44-4f2f-a7a4-f1fea5e394ea tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:10.943022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-37d53056-8f44-4f2f-a7a4-f1fea5e394ea tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:10.944100 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-37d53056-8f44-4f2f-a7a4-f1fea5e394ea tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:10.944704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-37d53056-8f44-4f2f-a7a4-f1fea5e394ea tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:11.114255 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-37d53056-8f44-4f2f-a7a4-f1fea5e394ea tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:11.128686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-37d53056-8f44-4f2f-a7a4-f1fea5e394ea tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.197949 Jun 15 10:18:11.131265 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 335/667] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:10 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:11.813280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:11.814030 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:11.831746 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:11.833124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:11.834618 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:11.835337 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:11.935331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-04ba7188-fb60-456b-834d-607d04155d8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:11.936575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-04ba7188-fb60-456b-834d-607d04155d8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:11.938793 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=4 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:11.940401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=74 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:11.949178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-04ba7188-fb60-456b-834d-607d04155d8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:11.949876 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-04ba7188-fb60-456b-834d-607d04155d8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:11.950854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-04ba7188-fb60-456b-834d-607d04155d8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:11.951462 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-04ba7188-fb60-456b-834d-607d04155d8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:12.068959 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:12.080809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:12.082787 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:12.086784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-514a9999-de4d-4206-806d-d6b0f5398f8d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.279438 Jun 15 10:18:12.097826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 333/668] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:11 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:12.147856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-762bcc10-fbea-49f4-94fe-8830f91173e8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:12.148660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-762bcc10-fbea-49f4-94fe-8830f91173e8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:12.155847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-762bcc10-fbea-49f4-94fe-8830f91173e8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:12.156298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-762bcc10-fbea-49f4-94fe-8830f91173e8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:12.157118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-762bcc10-fbea-49f4-94fe-8830f91173e8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:12.157554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-762bcc10-fbea-49f4-94fe-8830f91173e8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:12.157921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-04ba7188-fb60-456b-834d-607d04155d8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:12.166446 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-04ba7188-fb60-456b-834d-607d04155d8a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.234737 Jun 15 10:18:12.167334 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 336/669] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:11 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:12.316460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-762bcc10-fbea-49f4-94fe-8830f91173e8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:12.325339 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-762bcc10-fbea-49f4-94fe-8830f91173e8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.181844 Jun 15 10:18:12.325820 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 334/670] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:12 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:13.105586 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:13.106890 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:13.117509 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:13.117971 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:13.118897 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:13.119341 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:13.184050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f541d02f-4bca-4d67-8a3f-2aa6dd832179 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:13.184667 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f541d02f-4bca-4d67-8a3f-2aa6dd832179 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:13.191804 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f541d02f-4bca-4d67-8a3f-2aa6dd832179 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:13.192251 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f541d02f-4bca-4d67-8a3f-2aa6dd832179 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:13.193031 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f541d02f-4bca-4d67-8a3f-2aa6dd832179 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:13.193454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f541d02f-4bca-4d67-8a3f-2aa6dd832179 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:13.284992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:13.293096 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:13.294626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:13.295783 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b0ebb660-c2ad-4b95-a44e-80110ca817e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1738 microversion: 2.20 time: 0.194716 Jun 15 10:18:13.296342 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 337/671] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:13 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:13.343267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9b65d03e-29db-43ff-a9f6-425dbdac7215 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:13.343909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9b65d03e-29db-43ff-a9f6-425dbdac7215 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:13.350439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f541d02f-4bca-4d67-8a3f-2aa6dd832179 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:13.351185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b65d03e-29db-43ff-a9f6-425dbdac7215 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:13.351719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b65d03e-29db-43ff-a9f6-425dbdac7215 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:13.353189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b65d03e-29db-43ff-a9f6-425dbdac7215 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:13.354661 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9b65d03e-29db-43ff-a9f6-425dbdac7215 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:13.359755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f541d02f-4bca-4d67-8a3f-2aa6dd832179 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.178786 Jun 15 10:18:13.359755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 335/672] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:13 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:13.473250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-42b9e02e-0f6e-4272-98a2-548e7345d196 req-c7c9028f-595f-4996-8466-48bd8838b604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf752fce-11a0-452b-8a60-58506c708350", "name": "network-vif-plugged", "status": "completed", "tag": "7b5afd89-cb94-42ce-b94a-3ebec914a616"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:13.483295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-42b9e02e-0f6e-4272-98a2-548e7345d196 req-c7c9028f-595f-4996-8466-48bd8838b604 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:13.484095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-42b9e02e-0f6e-4272-98a2-548e7345d196 req-c7c9028f-595f-4996-8466-48bd8838b604 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:13.500704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-42b9e02e-0f6e-4272-98a2-548e7345d196 req-c7c9028f-595f-4996-8466-48bd8838b604 service nova] Creating event network-vif-plugged:7b5afd89-cb94-42ce-b94a-3ebec914a616 for instance bf752fce-11a0-452b-8a60-58506c708350 on hv-cinder-83028 Jun 15 10:18:13.502931 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9b65d03e-29db-43ff-a9f6-425dbdac7215 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:13.507354 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-42b9e02e-0f6e-4272-98a2-548e7345d196 req-c7c9028f-595f-4996-8466-48bd8838b604 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037983 Jun 15 10:18:13.508092 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 336/673] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:18:13.510809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9b65d03e-29db-43ff-a9f6-425dbdac7215 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.171795 Jun 15 10:18:13.511448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 338/674] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:13 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:14.315706 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:14.316401 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:14.322495 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:14.322941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:14.323694 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:14.324131 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:14.376027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-978ee2b8-27f9-4def-ad2d-4b530a9c3029 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:14.376569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-978ee2b8-27f9-4def-ad2d-4b530a9c3029 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:14.385698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-978ee2b8-27f9-4def-ad2d-4b530a9c3029 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:14.386151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-978ee2b8-27f9-4def-ad2d-4b530a9c3029 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:14.386958 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-978ee2b8-27f9-4def-ad2d-4b530a9c3029 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:14.387397 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-978ee2b8-27f9-4def-ad2d-4b530a9c3029 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:14.507606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:14.518463 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:14.520359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:14.521543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2e6358c6-bbb8-4554-a64d-e165a10ef09f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1720 microversion: 2.20 time: 0.210639 Jun 15 10:18:14.522354 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 337/675] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:14 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:14.536780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-57b90989-7e0d-47ac-a722-11e1fc96b4a8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:14.537392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-57b90989-7e0d-47ac-a722-11e1fc96b4a8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:14.543404 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-57b90989-7e0d-47ac-a722-11e1fc96b4a8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:14.543857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-57b90989-7e0d-47ac-a722-11e1fc96b4a8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:14.544650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-57b90989-7e0d-47ac-a722-11e1fc96b4a8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:14.545083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-57b90989-7e0d-47ac-a722-11e1fc96b4a8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:14.555099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-978ee2b8-27f9-4def-ad2d-4b530a9c3029 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:14.562780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-978ee2b8-27f9-4def-ad2d-4b530a9c3029 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.190554 Jun 15 10:18:14.563357 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 339/676] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:14 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:14.680374 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-57b90989-7e0d-47ac-a722-11e1fc96b4a8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:14.688059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-57b90989-7e0d-47ac-a722-11e1fc96b4a8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.156229 Jun 15 10:18:14.688634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 338/677] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:14 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:15.541175 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:15.542419 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:15.550120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:15.550631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:15.551434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:15.552247 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:15.579333 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-634fa3f2-7be4-4901-ae84-a21a47999405 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:15.579996 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-634fa3f2-7be4-4901-ae84-a21a47999405 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:15.588229 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-634fa3f2-7be4-4901-ae84-a21a47999405 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:15.588891 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-634fa3f2-7be4-4901-ae84-a21a47999405 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:15.589857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-634fa3f2-7be4-4901-ae84-a21a47999405 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:15.590493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-634fa3f2-7be4-4901-ae84-a21a47999405 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:16.029889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:16.038732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:16.040362 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:16.041523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c59cd30c-6065-49aa-9e9e-5ba5e6c004af tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1720 microversion: 2.20 time: 0.504519 Jun 15 10:18:16.042189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 340/678] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:15 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1720 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:16.046582 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6b5e7509-8574-4cde-bf69-7af5dd18488c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:16.047202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6b5e7509-8574-4cde-bf69-7af5dd18488c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:16.047828 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-634fa3f2-7be4-4901-ae84-a21a47999405 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:16.053444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6b5e7509-8574-4cde-bf69-7af5dd18488c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:16.054123 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6b5e7509-8574-4cde-bf69-7af5dd18488c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:16.054941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6b5e7509-8574-4cde-bf69-7af5dd18488c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:16.055382 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6b5e7509-8574-4cde-bf69-7af5dd18488c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:16.056939 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-634fa3f2-7be4-4901-ae84-a21a47999405 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.481324 Jun 15 10:18:16.059775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 339/679] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:15 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:16.226773 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6b5e7509-8574-4cde-bf69-7af5dd18488c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:16.234537 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6b5e7509-8574-4cde-bf69-7af5dd18488c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.191339 Jun 15 10:18:16.235102 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 341/680] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:16 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:17.060052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:17.060605 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:17.067355 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:17.067807 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:17.068581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:17.069022 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:17.075289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-76329ef8-5f2c-4abe-80c0-9803f75fd305 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:17.076125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-76329ef8-5f2c-4abe-80c0-9803f75fd305 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:17.084675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76329ef8-5f2c-4abe-80c0-9803f75fd305 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:17.085253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76329ef8-5f2c-4abe-80c0-9803f75fd305 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:17.086139 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76329ef8-5f2c-4abe-80c0-9803f75fd305 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:17.087015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76329ef8-5f2c-4abe-80c0-9803f75fd305 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:17.264458 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:17.274899 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:17.276425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:17.277790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1b1cc6ba-8f99-4718-9191-10a39edcfed9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1720 microversion: 2.20 time: 0.221692 Jun 15 10:18:17.278407 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 340/681] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:17 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:17.283091 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-64090b7b-b139-4a16-8d3f-ec997625522f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:17.283705 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-64090b7b-b139-4a16-8d3f-ec997625522f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:17.289987 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-64090b7b-b139-4a16-8d3f-ec997625522f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:17.290669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-64090b7b-b139-4a16-8d3f-ec997625522f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:17.291609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-64090b7b-b139-4a16-8d3f-ec997625522f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:17.292095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-64090b7b-b139-4a16-8d3f-ec997625522f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:17.302012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-76329ef8-5f2c-4abe-80c0-9803f75fd305 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:17.313062 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-76329ef8-5f2c-4abe-80c0-9803f75fd305 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1319 microversion: 2.1 time: 0.241587 Jun 15 10:18:17.314211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 342/682] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:17 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:17.512398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-ba506313-047c-483e-8cfe-e6b823069455 req-076eebd1-9b26-4ade-a7b0-75e0e16ce1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5ab626-a7eb-407e-b8a9-a768e57d4022", "name": "network-vif-unplugged", "status": "completed", "tag": "2021b47d-9010-4d70-8020-0269285a0559"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:17.521635 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-ba506313-047c-483e-8cfe-e6b823069455 req-076eebd1-9b26-4ade-a7b0-75e0e16ce1ff service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:17.522193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-ba506313-047c-483e-8cfe-e6b823069455 req-076eebd1-9b26-4ade-a7b0-75e0e16ce1ff service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:17.534170 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-ba506313-047c-483e-8cfe-e6b823069455 req-076eebd1-9b26-4ade-a7b0-75e0e16ce1ff service nova] Creating event network-vif-unplugged:2021b47d-9010-4d70-8020-0269285a0559 for instance af5ab626-a7eb-407e-b8a9-a768e57d4022 on hv-cinder-83028 Jun 15 10:18:17.539287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-ba506313-047c-483e-8cfe-e6b823069455 req-076eebd1-9b26-4ade-a7b0-75e0e16ce1ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031809 Jun 15 10:18:17.540005 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 343/683] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:18:17.548547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-64090b7b-b139-4a16-8d3f-ec997625522f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:17.557750 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-64090b7b-b139-4a16-8d3f-ec997625522f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.278087 Jun 15 10:18:17.567616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 341/684] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:17 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:18.296764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:18.298167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:18.304608 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:18.305266 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:18.306198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:18.306656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:18.334083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cfa615d2-30bf-4f84-8a1e-21337ccf3e81 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:18.334970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cfa615d2-30bf-4f84-8a1e-21337ccf3e81 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:18.344465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfa615d2-30bf-4f84-8a1e-21337ccf3e81 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:18.348685 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfa615d2-30bf-4f84-8a1e-21337ccf3e81 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:18.349629 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfa615d2-30bf-4f84-8a1e-21337ccf3e81 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:18.350183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfa615d2-30bf-4f84-8a1e-21337ccf3e81 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:18.638777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:18.647436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:18.648845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:18.650218 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e599edb9-985e-4d61-abf6-0fcdc1ba0e6d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1720 microversion: 2.20 time: 0.358254 Jun 15 10:18:18.650819 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 344/685] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:18 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1720 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:18.655459 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-95a3a538-e7a6-40bd-a319-64775e7e34fb tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:18.656444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-95a3a538-e7a6-40bd-a319-64775e7e34fb tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:18.664098 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95a3a538-e7a6-40bd-a319-64775e7e34fb tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:18.664553 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95a3a538-e7a6-40bd-a319-64775e7e34fb tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:18.665330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95a3a538-e7a6-40bd-a319-64775e7e34fb tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:18.665771 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95a3a538-e7a6-40bd-a319-64775e7e34fb tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:18.686026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cfa615d2-30bf-4f84-8a1e-21337ccf3e81 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:18.694444 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cfa615d2-30bf-4f84-8a1e-21337ccf3e81 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1509 microversion: 2.1 time: 0.367678 Jun 15 10:18:18.695121 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 342/686] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:18 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1509 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:18.713595 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-38f97482-5da6-4be9-931c-81013ec9e6a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a25effeb-b405-45e8-9d2a-15bda07ca53e", "device": "/dev/sdb"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:18.715467 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-38f97482-5da6-4be9-931c-81013ec9e6a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:18.723291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-38f97482-5da6-4be9-931c-81013ec9e6a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:18.724012 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-38f97482-5da6-4be9-931c-81013ec9e6a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:18.725329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-38f97482-5da6-4be9-931c-81013ec9e6a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:18.726375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-38f97482-5da6-4be9-931c-81013ec9e6a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:18.750596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:18.893980 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-95a3a538-e7a6-40bd-a319-64775e7e34fb tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:18.902777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-95a3a538-e7a6-40bd-a319-64775e7e34fb tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.250410 Jun 15 10:18:18.903796 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 345/687] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:18 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:19.671465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:19.672108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:19.678791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:19.679608 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:19.680493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:19.681118 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:19.837828 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:19.858803 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:19.860356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:19.862189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1f9dcedc-a618-457c-ae58-e2a8cb19c384 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1723 microversion: 2.20 time: 0.194336 Jun 15 10:18:19.870051 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 346/688] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:19 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:18:19.889345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8b51a4d6-8154-446b-9970-9d2afebfaf77 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f3facd6-6fdf-4ee5-b6f8-4f0f644b0cee"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:19.891345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8b51a4d6-8154-446b-9970-9d2afebfaf77 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:19.902767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8b51a4d6-8154-446b-9970-9d2afebfaf77 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:19.903664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8b51a4d6-8154-446b-9970-9d2afebfaf77 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:19.904713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8b51a4d6-8154-446b-9970-9d2afebfaf77 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:19.905318 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8b51a4d6-8154-446b-9970-9d2afebfaf77 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:20.184081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-38f97482-5da6-4be9-931c-81013ec9e6a0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "POST /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.474955 Jun 15 10:18:20.186980 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 343/689] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:18:18 2022] POST /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350/os-volume_attachments => generated 194 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:18:20.198881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b2d6f5fe-35f9-4394-9d83-7201155deef8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:20.202453 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b2d6f5fe-35f9-4394-9d83-7201155deef8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:20.216039 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b2d6f5fe-35f9-4394-9d83-7201155deef8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:20.216708 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b2d6f5fe-35f9-4394-9d83-7201155deef8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:20.217877 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b2d6f5fe-35f9-4394-9d83-7201155deef8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:20.218508 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b2d6f5fe-35f9-4394-9d83-7201155deef8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:20.276742 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:20.509270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8b51a4d6-8154-446b-9970-9d2afebfaf77 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.625086 Jun 15 10:18:20.514977 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 347/690] 10.222.0.57 () {62 vars in 1363 bytes} [Wed Jun 15 10:18:19 2022] POST /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments => generated 188 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:18:20.534778 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b2d6f5fe-35f9-4394-9d83-7201155deef8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:20.543959 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b2d6f5fe-35f9-4394-9d83-7201155deef8 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.354409 Jun 15 10:18:20.544840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 344/691] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:20 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:20.730552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6922684c-6dcc-4120-87a4-016485d6992a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:20.731134 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6922684c-6dcc-4120-87a4-016485d6992a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:20.741759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6922684c-6dcc-4120-87a4-016485d6992a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:20.742219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6922684c-6dcc-4120-87a4-016485d6992a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:20.743028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6922684c-6dcc-4120-87a4-016485d6992a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:20.743828 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6922684c-6dcc-4120-87a4-016485d6992a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:20.930311 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6922684c-6dcc-4120-87a4-016485d6992a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/action" status: 202 len: 0 microversion: 2.20 time: 0.205390 Jun 15 10:18:20.931642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 348/692] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Jun 15 10:18:20 2022] POST /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:18:20.939700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:20.940559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:20.950672 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:20.951127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:20.951921 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:20.952363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:21.206301 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:21.217432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:21.223888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:21.225332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6273814a-18e6-465a-af93-36de4f31a23b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1749 microversion: 2.20 time: 0.289899 Jun 15 10:18:21.238349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 345/693] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:20 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1749 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:21.575274 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d28b199c-b710-4f53-950f-08dc96ea88ac tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:21.575274 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d28b199c-b710-4f53-950f-08dc96ea88ac tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:21.581965 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d28b199c-b710-4f53-950f-08dc96ea88ac tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:21.582764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d28b199c-b710-4f53-950f-08dc96ea88ac tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:21.583714 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d28b199c-b710-4f53-950f-08dc96ea88ac tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:21.584674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d28b199c-b710-4f53-950f-08dc96ea88ac tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:21.834587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d28b199c-b710-4f53-950f-08dc96ea88ac tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:21.846099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d28b199c-b710-4f53-950f-08dc96ea88ac tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.284033 Jun 15 10:18:21.855686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 349/694] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:21 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:22.243907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:22.244466 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:22.264159 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:22.264492 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:22.265296 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:22.265738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:22.403001 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-1b9c19ce-940b-4722-bfb1-c39975a73078 req-bc7c1fb3-c5d5-4bab-ab61-dc68ef2176f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2b6202-44f6-40f9-849b-5803d6bc4804", "name": "network-vif-plugged", "status": "completed", "tag": "50a683de-f892-4296-bd13-128af91a8b71"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:22.420444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-1b9c19ce-940b-4722-bfb1-c39975a73078 req-bc7c1fb3-c5d5-4bab-ab61-dc68ef2176f6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:22.422225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-1b9c19ce-940b-4722-bfb1-c39975a73078 req-bc7c1fb3-c5d5-4bab-ab61-dc68ef2176f6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:22.447252 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-1b9c19ce-940b-4722-bfb1-c39975a73078 req-bc7c1fb3-c5d5-4bab-ab61-dc68ef2176f6 service nova] Creating event network-vif-plugged:50a683de-f892-4296-bd13-128af91a8b71 for instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 on hv-cinder-83028 Jun 15 10:18:22.453736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-1b9c19ce-940b-4722-bfb1-c39975a73078 req-bc7c1fb3-c5d5-4bab-ab61-dc68ef2176f6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057815 Jun 15 10:18:22.455183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 350/695] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:18:22.489845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:22.500959 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:22.503116 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:22.504493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e3f51236-a689-4d85-8410-638052713ffa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1749 microversion: 2.20 time: 0.264523 Jun 15 10:18:22.514883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 346/696] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:22 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1749 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:22.867234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9dc21d1e-d3be-43c1-a376-298774746a7e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:22.868575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9dc21d1e-d3be-43c1-a376-298774746a7e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:22.875865 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9dc21d1e-d3be-43c1-a376-298774746a7e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:22.876888 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9dc21d1e-d3be-43c1-a376-298774746a7e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:22.878207 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9dc21d1e-d3be-43c1-a376-298774746a7e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:22.878838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9dc21d1e-d3be-43c1-a376-298774746a7e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:23.107968 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9dc21d1e-d3be-43c1-a376-298774746a7e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:23.123528 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9dc21d1e-d3be-43c1-a376-298774746a7e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.263587 Jun 15 10:18:23.124779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 351/697] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:22 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:23.525346 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:23.526041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:23.551210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:23.551658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:23.552433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:23.552861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:23.699391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:23.708842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:23.710413 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:23.711574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4699a5fb-487c-433f-ab32-77e40c24e6ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1751 microversion: 2.20 time: 0.190288 Jun 15 10:18:23.712303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 347/698] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:23 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:24.142333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3b17be6b-9d21-41e9-a0a9-8fbc9da6325e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:24.143896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3b17be6b-9d21-41e9-a0a9-8fbc9da6325e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:24.151529 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b17be6b-9d21-41e9-a0a9-8fbc9da6325e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:24.152369 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b17be6b-9d21-41e9-a0a9-8fbc9da6325e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:24.153420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b17be6b-9d21-41e9-a0a9-8fbc9da6325e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:24.153924 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b17be6b-9d21-41e9-a0a9-8fbc9da6325e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:24.308151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b17be6b-9d21-41e9-a0a9-8fbc9da6325e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:24.316691 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3b17be6b-9d21-41e9-a0a9-8fbc9da6325e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1265 microversion: 2.1 time: 0.178634 Jun 15 10:18:24.317302 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 352/699] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:24 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:24.731488 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:24.732930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:24.742503 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:24.744300 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:24.745660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:24.747096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:24.973985 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:24.984241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:24.986073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:24.988243 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d6ca4591-d8fc-41b9-beab-700702662065 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1751 microversion: 2.20 time: 0.260873 Jun 15 10:18:24.989422 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 348/700] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:24 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:25.338394 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8b3d092a-621a-4d07-b9a3-de439a3bdc15 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:25.341489 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8b3d092a-621a-4d07-b9a3-de439a3bdc15 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:25.363827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8b3d092a-621a-4d07-b9a3-de439a3bdc15 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:25.365735 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8b3d092a-621a-4d07-b9a3-de439a3bdc15 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:25.366642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8b3d092a-621a-4d07-b9a3-de439a3bdc15 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:25.367724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8b3d092a-621a-4d07-b9a3-de439a3bdc15 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:25.989764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8b3d092a-621a-4d07-b9a3-de439a3bdc15 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:26.008051 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:26.009385 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:26.016232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8b3d092a-621a-4d07-b9a3-de439a3bdc15 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1450 microversion: 2.1 time: 0.669469 Jun 15 10:18:26.017855 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 353/701] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:25 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1450 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:26.022927 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:26.028507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:26.029771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:26.031204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:26.041326 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-efb8f39d-ec5f-46c2-be4f-87e3273c711c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:26.042127 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-efb8f39d-ec5f-46c2-be4f-87e3273c711c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:26.063305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efb8f39d-ec5f-46c2-be4f-87e3273c711c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:26.065292 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efb8f39d-ec5f-46c2-be4f-87e3273c711c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:26.071931 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efb8f39d-ec5f-46c2-be4f-87e3273c711c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:26.080246 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efb8f39d-ec5f-46c2-be4f-87e3273c711c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:26.809395 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:26.827763 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:26.833608 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:26.835239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-07400803-a713-4a65-b5f4-f58b620ed303 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1751 microversion: 2.20 time: 0.831837 Jun 15 10:18:26.836284 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 349/702] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:26 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1751 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:18:26.847412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-efb8f39d-ec5f-46c2-be4f-87e3273c711c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:26.859132 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-efb8f39d-ec5f-46c2-be4f-87e3273c711c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1450 microversion: 2.1 time: 0.824435 Jun 15 10:18:26.860285 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 354/703] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:26 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1450 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:27.855325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:27.859027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:27.899185 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:27.899897 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:27.901292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:27.902006 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:28.250181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:28.259806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:28.261441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:28.268721 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-23b883e3-9f57-421c-beda-4c0524e952ff tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1751 microversion: 2.20 time: 0.413562 Jun 15 10:18:28.269376 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 350/704] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:27 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1751 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:29.288359 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:29.289698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:29.301258 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:29.302203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:29.303679 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:29.304414 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:29.625372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:29.645745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:29.648897 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:29.655153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e851051b-0675-456c-8f0a-cae98f823dd3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1751 microversion: 2.20 time: 0.371022 Jun 15 10:18:29.656401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 355/705] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:29 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1751 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:29.778905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-55ed4c0c-6f1b-4d61-8d3c-809ce37a8c2d req-6da5c591-fb45-44ce-90ad-a1d90c745251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2b6202-44f6-40f9-849b-5803d6bc4804", "tag": "50a683de-f892-4296-bd13-128af91a8b71"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:29.787332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:29.789715 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-55ed4c0c-6f1b-4d61-8d3c-809ce37a8c2d req-6da5c591-fb45-44ce-90ad-a1d90c745251 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:29.790206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-55ed4c0c-6f1b-4d61-8d3c-809ce37a8c2d req-6da5c591-fb45-44ce-90ad-a1d90c745251 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:29.810507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-55ed4c0c-6f1b-4d61-8d3c-809ce37a8c2d req-6da5c591-fb45-44ce-90ad-a1d90c745251 service nova] Creating event network-changed:50a683de-f892-4296-bd13-128af91a8b71 for instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 on hv-cinder-83028 Jun 15 10:18:29.818966 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-55ed4c0c-6f1b-4d61-8d3c-809ce37a8c2d req-6da5c591-fb45-44ce-90ad-a1d90c745251 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044360 Jun 15 10:18:29.827973 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 351/706] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:18:30.673176 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:30.675008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:30.682009 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:30.682883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:30.684159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:30.685032 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:30.975483 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:30.990661 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:30.992346 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:30.997021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-23dde3aa-f7d2-4b51-be75-50b58a53203f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.327872 Jun 15 10:18:31.004104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 356/707] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:30 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:32.016863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:32.018297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:32.030178 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:32.030926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:32.032424 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:32.033027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:32.181132 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:32.189848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:32.191998 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:32.193225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2a71348c-5d85-483d-9d1e-cd4b68a55167 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.181369 Jun 15 10:18:32.203758 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 352/708] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:32 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:33.213176 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:33.213785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:33.220984 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:33.221439 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:33.222656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:33.223250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:33.370032 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:33.380180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:33.382101 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:33.383289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b13ae4e9-f61a-49be-8070-e8a0e4b5f6e0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.174362 Jun 15 10:18:33.394920 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 357/709] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:33 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:34.401303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:34.401931 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:34.410613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:34.411349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:34.412295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:34.423436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:34.587770 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:34.598854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:34.600336 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:34.601695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-846746f2-8bb8-4b37-a0c6-17f6c21a0c3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.204677 Jun 15 10:18:34.602708 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 353/710] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:34 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:35.621214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:35.622543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:35.634574 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:35.635340 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:35.636305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:35.636998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:35.836114 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:35.847431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:35.850345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:35.852421 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8bdddaa2-54b8-4604-bb7f-28cf6d763a33 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.235543 Jun 15 10:18:35.863420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 358/711] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:35 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:36.871702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:36.872661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:36.894406 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:36.897417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:36.899120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:36.903294 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:37.174026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:37.187190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:37.190483 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:37.192370 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8c97b35b-43b0-48b7-a996-026fdb149b27 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.325362 Jun 15 10:18:37.203080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 354/712] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:36 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:38.213290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:38.214650 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:38.224351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:38.225126 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:38.226190 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:38.226643 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:38.471393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:38.480929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:38.482635 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:38.484236 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4c6cafff-557e-4dad-b7da-07825bdb8e43 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.275128 Jun 15 10:18:38.485589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 359/713] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:38 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:39.150253 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-475a5be9-bb74-48f8-87b5-079c6e52285c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Action: 'create', calling method: .version_select at 0x7fe255ffbf70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-60298543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJe4m6KhIf10qJZ0uka4pu3GteiCDk2/KSeq8DvwfHD42DQQZK3wIhnV/WmFU2CycLRQl6YeicWRg7mcsOnz8ZnWb6Tn85KkZUebQG6dLgNRYoRC38hVAa7zti49hEuXBg=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:39.165237 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-475a5be9-bb74-48f8-87b5-079c6e52285c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Getting quotas for project d6ff13b44dc940beaa20649cc649b32f. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:18:39.169745 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-475a5be9-bb74-48f8-87b5-079c6e52285c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Getting quotas for user 07fc13bc9b914ac48cd8aa5e4728f000 and project d6ff13b44dc940beaa20649cc649b32f. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:18:39.182574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR oslo.messaging._drivers.impl_rabbit [None req-475a5be9-bb74-48f8-87b5-079c6e52285c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [7dc6b767-8700-45b4-9d13-2ea8f63e772b] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 10:18:39.504154 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:39.504826 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:39.511599 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:39.512059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:39.512827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:39.513297 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:39.645675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:39.653923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:39.655454 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:39.657140 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a80afc3b-789e-42a6-9c09-5eaf7e2a416d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.156581 Jun 15 10:18:39.657693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 360/714] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:39 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:18:40.191816 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [None req-475a5be9-bb74-48f8-87b5-079c6e52285c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [7dc6b767-8700-45b4-9d13-2ea8f63e772b] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 49134. Jun 15 10:18:40.207113 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-475a5be9-bb74-48f8-87b5-079c6e52285c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 1.060782 Jun 15 10:18:40.207714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 355/715] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:18:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:18:40.256510 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1188518030", "imageRef": "849de37d-088e-4f1f-afcf-7766794bb1c5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-60298543", "networks": [{"uuid": "30906d5f-3246-4673-970b-ab8126b70926"}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:18:40.304733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] validate_networks() for [('30906d5f-3246-4673-970b-ab8126b70926', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:18:40.675290 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:40.675821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:40.682332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:40.682785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:40.683557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:40.683993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:40.741705 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:18:40.742179 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:18:40.742625 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:18:40.743048 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:18:40.743705 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:18:40.754549 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:40.755766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:40.756572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:40.757021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:40.775459 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Getting quotas for project d6ff13b44dc940beaa20649cc649b32f. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:18:40.779388 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Getting quotas for user 07fc13bc9b914ac48cd8aa5e4728f000 and project d6ff13b44dc940beaa20649cc649b32f. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:18:40.790784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:18:40.793092 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='849de37d-088e-4f1f-afcf-7766794bb1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:18:40.831609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:40.841430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:40.842829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0c85ab12-3f76-4bb9-af4a-0b4d81fce025 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590162 Jun 15 10:18:40.846333 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:40.846522 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 361/716] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:18:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:18:40.846634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-17348cce-73a4-4fa7-8718-3efd1755c6d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.174666 Jun 15 10:18:40.849793 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 356/717] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:40 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:18:40.862501 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-da86c532-95b7-45d7-856f-e0505292692f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:40.863133 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-da86c532-95b7-45d7-856f-e0505292692f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:40.917128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-da86c532-95b7-45d7-856f-e0505292692f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:40.924444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-da86c532-95b7-45d7-856f-e0505292692f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1257 microversion: 2.1 time: 0.068498 Jun 15 10:18:40.925008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 362/718] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:40 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:41.941060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ef4de4e1-ca63-40a5-9cd6-6920fbd18017 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:41.941739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ef4de4e1-ca63-40a5-9cd6-6920fbd18017 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:41.949620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef4de4e1-ca63-40a5-9cd6-6920fbd18017 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:41.950067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef4de4e1-ca63-40a5-9cd6-6920fbd18017 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:41.950861 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef4de4e1-ca63-40a5-9cd6-6920fbd18017 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:41.951294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef4de4e1-ca63-40a5-9cd6-6920fbd18017 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:41.995554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:41.996165 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:42.003194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:42.003731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:42.004647 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:42.005190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:42.024680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ef4de4e1-ca63-40a5-9cd6-6920fbd18017 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:42.036178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ef4de4e1-ca63-40a5-9cd6-6920fbd18017 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.098761 Jun 15 10:18:42.037332 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 363/719] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:41 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:42.158226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:42.171607 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:42.173878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:42.175662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e8bee2a7-464e-45f9-a9d9-cc4381bede42 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.313994 Jun 15 10:18:42.176680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 357/720] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:41 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:18:43.055775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-67230f17-c4e2-4725-95bb-c48717a253ed tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:43.056409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-67230f17-c4e2-4725-95bb-c48717a253ed tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:43.058824 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:43.065110 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-67230f17-c4e2-4725-95bb-c48717a253ed tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:43.065554 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-67230f17-c4e2-4725-95bb-c48717a253ed tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:43.066330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-67230f17-c4e2-4725-95bb-c48717a253ed tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:43.066764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-67230f17-c4e2-4725-95bb-c48717a253ed tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:43.069742 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:43.129416 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-67230f17-c4e2-4725-95bb-c48717a253ed tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:43.136748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-67230f17-c4e2-4725-95bb-c48717a253ed tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.084845 Jun 15 10:18:43.137308 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 364/721] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:43 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:43.196549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:43.197949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:43.204872 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:43.205570 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:43.206534 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:43.207121 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:43.352505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:43.361363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:43.362889 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:43.364042 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d82246fe-188c-4126-9227-18e18983f017 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.171397 Jun 15 10:18:43.364597 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 358/722] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:43 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:44.161555 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3d340bf2-c393-4e58-b79f-1030200f800e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:44.162172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3d340bf2-c393-4e58-b79f-1030200f800e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:44.168700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3d340bf2-c393-4e58-b79f-1030200f800e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:44.169150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3d340bf2-c393-4e58-b79f-1030200f800e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:44.169918 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3d340bf2-c393-4e58-b79f-1030200f800e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:44.170392 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3d340bf2-c393-4e58-b79f-1030200f800e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:44.230660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3d340bf2-c393-4e58-b79f-1030200f800e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:44.239079 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3d340bf2-c393-4e58-b79f-1030200f800e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.081391 Jun 15 10:18:44.239642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 365/723] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:44 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:44.381135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:44.381684 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:44.388115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:44.388600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:44.389393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:44.389863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:44.519809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:44.528066 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:44.529557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:44.530743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-06168dc1-5a1c-4564-8a87-875f17f7d1d2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.153579 Jun 15 10:18:44.532450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 359/724] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:44 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:45.255779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7edf6133-0fff-424a-96f3-62438e0e76e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:45.257193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7edf6133-0fff-424a-96f3-62438e0e76e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:45.263786 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7edf6133-0fff-424a-96f3-62438e0e76e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:45.264251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7edf6133-0fff-424a-96f3-62438e0e76e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:45.265032 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7edf6133-0fff-424a-96f3-62438e0e76e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:45.266221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7edf6133-0fff-424a-96f3-62438e0e76e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:45.336487 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7edf6133-0fff-424a-96f3-62438e0e76e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:45.344984 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7edf6133-0fff-424a-96f3-62438e0e76e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.093024 Jun 15 10:18:45.345638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 366/725] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:45 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:45.550183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:45.550885 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:45.557512 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:45.557951 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:45.558745 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:45.559184 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:45.575452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:45.726017 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:45.735194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:45.736710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:45.737864 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0eb76bb0-1e8a-442e-8243-e5f2b48d2d3b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.191607 Jun 15 10:18:45.738451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 360/726] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:45 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:46.361167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48973f3b-aa45-414c-bbee-894c734ca0af tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:46.361832 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-48973f3b-aa45-414c-bbee-894c734ca0af tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:46.368497 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48973f3b-aa45-414c-bbee-894c734ca0af tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:46.368887 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48973f3b-aa45-414c-bbee-894c734ca0af tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:46.369648 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48973f3b-aa45-414c-bbee-894c734ca0af tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:46.370091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48973f3b-aa45-414c-bbee-894c734ca0af tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:46.438540 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-48973f3b-aa45-414c-bbee-894c734ca0af tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:46.463993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-48973f3b-aa45-414c-bbee-894c734ca0af tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.106758 Jun 15 10:18:46.465345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 367/727] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:46 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:46.756438 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:46.757081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:46.763512 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:46.763962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:46.764720 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:46.765155 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:46.899955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:46.908889 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:46.910423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:46.911579 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-599d9308-47ab-4739-8645-91d78ce392b2 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.159028 Jun 15 10:18:46.912143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 361/728] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:46 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:47.481068 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6051e7d5-1f90-41a8-aa21-86ffb8bf4d37 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:47.481684 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6051e7d5-1f90-41a8-aa21-86ffb8bf4d37 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:47.488368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6051e7d5-1f90-41a8-aa21-86ffb8bf4d37 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:47.488823 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6051e7d5-1f90-41a8-aa21-86ffb8bf4d37 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:47.489591 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6051e7d5-1f90-41a8-aa21-86ffb8bf4d37 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:47.490026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6051e7d5-1f90-41a8-aa21-86ffb8bf4d37 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:47.581970 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6051e7d5-1f90-41a8-aa21-86ffb8bf4d37 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:47.591126 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6051e7d5-1f90-41a8-aa21-86ffb8bf4d37 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.113815 Jun 15 10:18:47.592063 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 368/729] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:47 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:47.930562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:47.931259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:47.940005 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:47.940624 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:47.941413 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:47.942085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:48.088925 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:48.097800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:48.099326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:48.100481 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-045b3298-1121-4caf-bab8-26660cb463a8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.173861 Jun 15 10:18:48.101039 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 362/730] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:47 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:48.609109 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d361dde2-0979-424f-80e3-9864cd17634c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:48.609763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d361dde2-0979-424f-80e3-9864cd17634c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:48.616162 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d361dde2-0979-424f-80e3-9864cd17634c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:48.616616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d361dde2-0979-424f-80e3-9864cd17634c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:48.617373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d361dde2-0979-424f-80e3-9864cd17634c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:48.617812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d361dde2-0979-424f-80e3-9864cd17634c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:48.683003 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d361dde2-0979-424f-80e3-9864cd17634c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:48.691451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d361dde2-0979-424f-80e3-9864cd17634c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.086123 Jun 15 10:18:48.692037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 369/731] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:48 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:48.706324 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c6027d01-cc76-400b-b37b-1eeeb6ef6a95 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:48.707019 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c6027d01-cc76-400b-b37b-1eeeb6ef6a95 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:48.713734 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c6027d01-cc76-400b-b37b-1eeeb6ef6a95 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:48.714301 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c6027d01-cc76-400b-b37b-1eeeb6ef6a95 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:48.715208 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c6027d01-cc76-400b-b37b-1eeeb6ef6a95 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:48.715757 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c6027d01-cc76-400b-b37b-1eeeb6ef6a95 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:48.852279 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-c6027d01-cc76-400b-b37b-1eeeb6ef6a95 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lazy-loading 'services' on Instance uuid bf752fce-11a0-452b-8a60-58506c708350 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:18:48.966955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c6027d01-cc76-400b-b37b-1eeeb6ef6a95 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350/os-volume_attachments/a25effeb-b405-45e8-9d2a-15bda07ca53e" status: 202 len: 0 microversion: 2.1 time: 0.265067 Jun 15 10:18:48.967979 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 363/732] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:18:48 2022] DELETE /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350/os-volume_attachments/a25effeb-b405-45e8-9d2a-15bda07ca53e => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:18:49.122351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:49.123050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:49.131189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:49.132299 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:49.133458 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:49.134202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:49.298477 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:49.306848 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:49.308328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:49.309469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-650adf00-1eda-42bd-91b8-16d3a201b482 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.191507 Jun 15 10:18:49.310028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 370/733] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:49 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:49.706366 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=4 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:49.711183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-21a0784b-db6d-4327-bb47-4dfeb0756d2d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:49.711896 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-21a0784b-db6d-4327-bb47-4dfeb0756d2d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:49.720959 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21a0784b-db6d-4327-bb47-4dfeb0756d2d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:49.721790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21a0784b-db6d-4327-bb47-4dfeb0756d2d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:49.722857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21a0784b-db6d-4327-bb47-4dfeb0756d2d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:49.723545 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21a0784b-db6d-4327-bb47-4dfeb0756d2d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:49.787832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-21a0784b-db6d-4327-bb47-4dfeb0756d2d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:49.795197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-21a0784b-db6d-4327-bb47-4dfeb0756d2d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.089937 Jun 15 10:18:49.795756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 364/734] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:49 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:50.330138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:50.331992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:50.341088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:50.341767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:50.342658 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:50.343229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:50.480394 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:50.489663 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:50.491206 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:50.492366 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a66cfdc7-9a10-412d-a8d8-fd90af21205f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.167971 Jun 15 10:18:50.492929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 371/735] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:50 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:50.812098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-99e78cc6-fd53-4ed4-a17f-b6763ed615c3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:50.812972 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-99e78cc6-fd53-4ed4-a17f-b6763ed615c3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:50.820483 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-99e78cc6-fd53-4ed4-a17f-b6763ed615c3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:50.821011 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-99e78cc6-fd53-4ed4-a17f-b6763ed615c3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:50.821794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-99e78cc6-fd53-4ed4-a17f-b6763ed615c3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:50.822239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-99e78cc6-fd53-4ed4-a17f-b6763ed615c3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:50.886186 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-99e78cc6-fd53-4ed4-a17f-b6763ed615c3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:50.896670 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-99e78cc6-fd53-4ed4-a17f-b6763ed615c3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.088459 Jun 15 10:18:50.897953 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 365/736] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:50 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:51.511488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:51.512986 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:51.515419 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:51.517526 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=8 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:18:51.525004 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:51.525847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:51.527304 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:51.528024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:51.665267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:51.673516 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:51.675050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:51.676194 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6cafca20-519c-46be-a99a-7c0c078ab17b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.168864 Jun 15 10:18:51.676745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 372/737] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:51 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:51.917905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6896a26c-da5a-4639-a67c-ad53a7155c34 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:51.918536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6896a26c-da5a-4639-a67c-ad53a7155c34 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:51.925846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6896a26c-da5a-4639-a67c-ad53a7155c34 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:51.926424 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6896a26c-da5a-4639-a67c-ad53a7155c34 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:51.927226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6896a26c-da5a-4639-a67c-ad53a7155c34 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:51.927658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6896a26c-da5a-4639-a67c-ad53a7155c34 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:51.994535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6896a26c-da5a-4639-a67c-ad53a7155c34 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:52.002658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6896a26c-da5a-4639-a67c-ad53a7155c34 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.088483 Jun 15 10:18:52.003232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 366/738] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:51 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:52.694748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:52.695398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:52.701794 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:52.702249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:52.703031 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:52.703465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:52.839183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:52.848543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:52.850047 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:52.851231 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1c389718-0daa-4332-87ee-3fcbb9d22bd8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.160724 Jun 15 10:18:52.852075 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 373/739] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:52 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:53.019463 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-11e450ad-3737-4bfc-98f1-cac17269b092 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:53.020068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-11e450ad-3737-4bfc-98f1-cac17269b092 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:53.026539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11e450ad-3737-4bfc-98f1-cac17269b092 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:53.026979 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11e450ad-3737-4bfc-98f1-cac17269b092 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:53.027728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11e450ad-3737-4bfc-98f1-cac17269b092 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:53.028158 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-11e450ad-3737-4bfc-98f1-cac17269b092 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:53.087067 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-11e450ad-3737-4bfc-98f1-cac17269b092 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:53.094774 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-11e450ad-3737-4bfc-98f1-cac17269b092 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.078681 Jun 15 10:18:53.095335 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 367/740] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:53 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:53.870090 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:53.870732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:53.878181 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:53.878660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:53.879429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:53.879873 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:54.011461 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:54.020348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:54.021847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:54.023030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4e596794-cff8-4e3d-b2bd-2c1c01027723 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.156902 Jun 15 10:18:54.023589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 374/741] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:53 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:54.112344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7035de2d-33bb-4031-8ffa-1f222838da52 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:54.112894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7035de2d-33bb-4031-8ffa-1f222838da52 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:54.119433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7035de2d-33bb-4031-8ffa-1f222838da52 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:54.119882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7035de2d-33bb-4031-8ffa-1f222838da52 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:54.120649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7035de2d-33bb-4031-8ffa-1f222838da52 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:54.121086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7035de2d-33bb-4031-8ffa-1f222838da52 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:54.181746 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7035de2d-33bb-4031-8ffa-1f222838da52 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:54.190777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7035de2d-33bb-4031-8ffa-1f222838da52 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.082702 Jun 15 10:18:54.191367 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 368/742] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:54 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:55.041387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:55.041993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:55.048446 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:55.048889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:55.049637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:55.050070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:55.179709 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:55.188653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:55.190151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:55.191323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1f040911-f3c0-4fa3-bc59-27673e8260cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.153846 Jun 15 10:18:55.191873 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 375/743] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:55 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:55.208227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-749c27c9-7d0f-4d36-9920-00c06d3fb34c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:55.208832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-749c27c9-7d0f-4d36-9920-00c06d3fb34c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:55.214839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-749c27c9-7d0f-4d36-9920-00c06d3fb34c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:55.215282 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-749c27c9-7d0f-4d36-9920-00c06d3fb34c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:55.216031 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-749c27c9-7d0f-4d36-9920-00c06d3fb34c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:55.216459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-749c27c9-7d0f-4d36-9920-00c06d3fb34c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:55.278723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-749c27c9-7d0f-4d36-9920-00c06d3fb34c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:55.286075 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-749c27c9-7d0f-4d36-9920-00c06d3fb34c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.082798 Jun 15 10:18:55.286654 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 369/744] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:55 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:56.208904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:56.209505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:56.215932 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:56.216381 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:56.217127 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:56.217554 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:56.302995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0d3bf40c-292a-42ea-818a-3b88ca7e60fa tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:56.303612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0d3bf40c-292a-42ea-818a-3b88ca7e60fa tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:56.310613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d3bf40c-292a-42ea-818a-3b88ca7e60fa tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:56.311072 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d3bf40c-292a-42ea-818a-3b88ca7e60fa tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:56.312026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d3bf40c-292a-42ea-818a-3b88ca7e60fa tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:56.312458 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0d3bf40c-292a-42ea-818a-3b88ca7e60fa tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:56.369250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:56.382700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:56.385031 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:56.386600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6137bbb4-f75a-4eee-98dc-142d310ca050 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.181472 Jun 15 10:18:56.397081 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 376/745] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:56 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:56.398895 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0d3bf40c-292a-42ea-818a-3b88ca7e60fa tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:56.415454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0d3bf40c-292a-42ea-818a-3b88ca7e60fa tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.116154 Jun 15 10:18:56.416028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 370/746] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:56 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:57.404132 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:57.404736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:57.411767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:57.412204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:57.412953 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:57.413382 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:57.433883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5afdb5c4-6ed9-48a9-b24f-d454586a28b4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:57.434594 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5afdb5c4-6ed9-48a9-b24f-d454586a28b4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:57.441869 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5afdb5c4-6ed9-48a9-b24f-d454586a28b4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:57.442348 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5afdb5c4-6ed9-48a9-b24f-d454586a28b4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:57.443156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5afdb5c4-6ed9-48a9-b24f-d454586a28b4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:57.443598 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5afdb5c4-6ed9-48a9-b24f-d454586a28b4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:57.513302 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5afdb5c4-6ed9-48a9-b24f-d454586a28b4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:57.521289 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5afdb5c4-6ed9-48a9-b24f-d454586a28b4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1261 microversion: 2.1 time: 0.092198 Jun 15 10:18:57.521901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 371/747] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:57 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:18:57.573180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:57.581873 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:57.583424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:57.584585 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6f9e716c-291d-4494-9899-d50138c2b6f8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.184301 Jun 15 10:18:57.585137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 377/748] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:57 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:18:58.537136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4129e8fd-72f4-4e3d-b3d2-bbf947e12dbc tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:58.537752 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4129e8fd-72f4-4e3d-b3d2-bbf947e12dbc tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:58.544133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4129e8fd-72f4-4e3d-b3d2-bbf947e12dbc tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:58.544580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4129e8fd-72f4-4e3d-b3d2-bbf947e12dbc tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:58.545338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4129e8fd-72f4-4e3d-b3d2-bbf947e12dbc tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:58.545782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4129e8fd-72f4-4e3d-b3d2-bbf947e12dbc tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:58.602938 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:58.603550 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:58.611436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4129e8fd-72f4-4e3d-b3d2-bbf947e12dbc tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:58.611671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:58.612559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:58.613499 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:58.613978 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:58.619188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4129e8fd-72f4-4e3d-b3d2-bbf947e12dbc tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1253 microversion: 2.1 time: 0.085909 Jun 15 10:18:58.619754 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 372/749] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:58 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:58.742727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:58.751931 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:58.753425 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:58.754612 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bc981cc2-03d3-4df0-b9b4-fbbd854a02cf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.155767 Jun 15 10:18:58.755177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 378/750] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:58 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:18:59.637120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-55ddf5df-a51c-4406-aab9-7effb6310584 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:59.637863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-55ddf5df-a51c-4406-aab9-7effb6310584 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:59.645593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55ddf5df-a51c-4406-aab9-7effb6310584 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:59.646323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55ddf5df-a51c-4406-aab9-7effb6310584 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:59.647457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55ddf5df-a51c-4406-aab9-7effb6310584 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:59.648137 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55ddf5df-a51c-4406-aab9-7effb6310584 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:59.748512 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-55ddf5df-a51c-4406-aab9-7effb6310584 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:18:59.758490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-55ddf5df-a51c-4406-aab9-7effb6310584 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1327 microversion: 2.1 time: 0.124823 Jun 15 10:18:59.762298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 373/751] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:18:59 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:18:59.775540 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:18:59.776542 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:18:59.786701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:59.787572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:18:59.790141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:18:59.790829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:00.226288 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:00.237222 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:00.240312 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:00.242239 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9816187e-fb67-41ed-a1c4-e583dce796b7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.472945 Jun 15 10:19:00.243539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 379/752] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:18:59 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:00.641954 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a1331cc8-b44d-49cc-9436-2204a36d76a6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:00.642560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a1331cc8-b44d-49cc-9436-2204a36d76a6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:00.644612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:00.650135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a1331cc8-b44d-49cc-9436-2204a36d76a6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:00.650613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a1331cc8-b44d-49cc-9436-2204a36d76a6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:00.651597 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a1331cc8-b44d-49cc-9436-2204a36d76a6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:00.652044 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a1331cc8-b44d-49cc-9436-2204a36d76a6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:00.685539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a1331cc8-b44d-49cc-9436-2204a36d76a6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:19:00.757238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:00.778532 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f4d908cb-febb-42a4-bb88-b9b85aaed71a tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:00.779205 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f4d908cb-febb-42a4-bb88-b9b85aaed71a tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:00.791231 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4d908cb-febb-42a4-bb88-b9b85aaed71a tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:00.792024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4d908cb-febb-42a4-bb88-b9b85aaed71a tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:00.795237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4d908cb-febb-42a4-bb88-b9b85aaed71a tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:00.798320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f4d908cb-febb-42a4-bb88-b9b85aaed71a tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:00.823981 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a1331cc8-b44d-49cc-9436-2204a36d76a6 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 204 len: 0 microversion: 2.1 time: 0.186142 Jun 15 10:19:00.828854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 374/753] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:19:00 2022] DELETE /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:19:00.840976 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ced292ee-b884-49e0-8f1f-5b4c5873b22d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:00.842302 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ced292ee-b884-49e0-8f1f-5b4c5873b22d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:00.850547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ced292ee-b884-49e0-8f1f-5b4c5873b22d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:00.855178 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ced292ee-b884-49e0-8f1f-5b4c5873b22d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:00.856103 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ced292ee-b884-49e0-8f1f-5b4c5873b22d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:00.856632 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ced292ee-b884-49e0-8f1f-5b4c5873b22d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:01.068187 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f4d908cb-febb-42a4-bb88-b9b85aaed71a tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:01.070552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:01.072718 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ced292ee-b884-49e0-8f1f-5b4c5873b22d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:01.077423 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f4d908cb-febb-42a4-bb88-b9b85aaed71a tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.304274 Jun 15 10:19:01.078538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 380/754] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:00 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:01.081345 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ced292ee-b884-49e0-8f1f-5b4c5873b22d tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.250157 Jun 15 10:19:01.081983 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 375/755] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:00 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:01.261492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:01.262172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:01.268965 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:01.269417 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:01.270193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:01.270662 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:01.431405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:01.440524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:01.442031 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:01.443219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-655e5356-9562-4844-8590-3ee8da35f000 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.185698 Jun 15 10:19:01.443776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 381/756] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:01 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:02.097009 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3a58b652-db92-4866-8a04-f90d4cb49241 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:02.097707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3a58b652-db92-4866-8a04-f90d4cb49241 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:02.106027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a58b652-db92-4866-8a04-f90d4cb49241 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:02.106516 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a58b652-db92-4866-8a04-f90d4cb49241 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:02.107056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-001afefe-5f54-4989-b607-bf50fae7eb92 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:02.107514 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a58b652-db92-4866-8a04-f90d4cb49241 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:02.107681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-001afefe-5f54-4989-b607-bf50fae7eb92 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:02.107782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a58b652-db92-4866-8a04-f90d4cb49241 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:02.115951 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-001afefe-5f54-4989-b607-bf50fae7eb92 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:02.116410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-001afefe-5f54-4989-b607-bf50fae7eb92 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:02.117192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-001afefe-5f54-4989-b607-bf50fae7eb92 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:02.117992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-001afefe-5f54-4989-b607-bf50fae7eb92 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:02.319195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3a58b652-db92-4866-8a04-f90d4cb49241 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:02.326180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-001afefe-5f54-4989-b607-bf50fae7eb92 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:02.332470 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3a58b652-db92-4866-8a04-f90d4cb49241 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.241151 Jun 15 10:19:02.333478 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 376/757] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:02 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:02.347725 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-001afefe-5f54-4989-b607-bf50fae7eb92 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.252019 Jun 15 10:19:02.348864 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 382/758] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:02 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:02.462749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:02.463356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:02.469968 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:02.470460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:02.471223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:02.471651 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:02.605850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:02.614613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:02.616124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:02.617313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d9ecdc2f-ee51-4f2a-a701-71a287ab1431 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.158576 Jun 15 10:19:02.617896 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 377/759] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:02 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:03.349586 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48ac2c30-e150-46b5-9648-f0c2fff1b31b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:03.350202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-48ac2c30-e150-46b5-9648-f0c2fff1b31b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:03.356898 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48ac2c30-e150-46b5-9648-f0c2fff1b31b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:03.357351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48ac2c30-e150-46b5-9648-f0c2fff1b31b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:03.358114 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48ac2c30-e150-46b5-9648-f0c2fff1b31b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:03.358579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48ac2c30-e150-46b5-9648-f0c2fff1b31b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:03.367256 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4ba90648-8aee-4da7-84b6-28f6f4b35dca tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:03.367784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4ba90648-8aee-4da7-84b6-28f6f4b35dca tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:03.374178 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ba90648-8aee-4da7-84b6-28f6f4b35dca tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:03.375006 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ba90648-8aee-4da7-84b6-28f6f4b35dca tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:03.375878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ba90648-8aee-4da7-84b6-28f6f4b35dca tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:03.376320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4ba90648-8aee-4da7-84b6-28f6f4b35dca tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:03.582853 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-48ac2c30-e150-46b5-9648-f0c2fff1b31b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:03.586153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4ba90648-8aee-4da7-84b6-28f6f4b35dca tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:03.590360 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-48ac2c30-e150-46b5-9648-f0c2fff1b31b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.244596 Jun 15 10:19:03.591014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 383/760] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:03 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:03.594060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4ba90648-8aee-4da7-84b6-28f6f4b35dca tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.230147 Jun 15 10:19:03.594748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 378/761] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:03 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:03.639527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:03.640142 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:03.646367 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:03.646855 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:03.647632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:03.648072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:03.788852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:03.799490 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:03.800994 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:03.802260 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6c8abd8f-c115-4c1f-a34a-c4599db01132 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.166570 Jun 15 10:19:03.802859 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 384/762] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:03 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:04.614315 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0c9157e1-6a33-4761-b37f-e9bf42655722 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:04.615020 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0c9157e1-6a33-4761-b37f-e9bf42655722 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:04.620044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ebf1906f-ec3c-4cac-a80b-c19e95c0c21e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:04.620836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ebf1906f-ec3c-4cac-a80b-c19e95c0c21e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:04.628166 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ebf1906f-ec3c-4cac-a80b-c19e95c0c21e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:04.632247 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c9157e1-6a33-4761-b37f-e9bf42655722 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:04.632710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c9157e1-6a33-4761-b37f-e9bf42655722 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:04.632998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ebf1906f-ec3c-4cac-a80b-c19e95c0c21e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:04.633503 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c9157e1-6a33-4761-b37f-e9bf42655722 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:04.633949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c9157e1-6a33-4761-b37f-e9bf42655722 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:04.634174 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ebf1906f-ec3c-4cac-a80b-c19e95c0c21e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:04.634595 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ebf1906f-ec3c-4cac-a80b-c19e95c0c21e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:04.847823 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ebf1906f-ec3c-4cac-a80b-c19e95c0c21e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:04.852166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0c9157e1-6a33-4761-b37f-e9bf42655722 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:04.858248 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ebf1906f-ec3c-4cac-a80b-c19e95c0c21e tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.250843 Jun 15 10:19:04.861098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0c9157e1-6a33-4761-b37f-e9bf42655722 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.257430 Jun 15 10:19:04.866437 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 379/763] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:04 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:04.866589 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:04.867115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:04.868400 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 385/764] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:04 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:04.872996 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:04.873439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:04.874190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:04.874900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:05.007657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:05.016099 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:05.017599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:05.018797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-49cca7dc-ee36-4634-b5fb-0a1628fb0d46 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.155797 Jun 15 10:19:05.019357 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 380/765] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:04 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:05.885342 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-147bb087-40ac-4d91-9f46-5286b4ecdbb0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:05.888422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-147bb087-40ac-4d91-9f46-5286b4ecdbb0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:05.889469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fe48a1cc-de43-4f5a-85eb-6e5c51c38124 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:05.891441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fe48a1cc-de43-4f5a-85eb-6e5c51c38124 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:05.898685 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe48a1cc-de43-4f5a-85eb-6e5c51c38124 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:05.899631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe48a1cc-de43-4f5a-85eb-6e5c51c38124 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:05.900337 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-147bb087-40ac-4d91-9f46-5286b4ecdbb0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:05.900782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe48a1cc-de43-4f5a-85eb-6e5c51c38124 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:05.900909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-147bb087-40ac-4d91-9f46-5286b4ecdbb0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:05.901496 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe48a1cc-de43-4f5a-85eb-6e5c51c38124 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:05.903275 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-147bb087-40ac-4d91-9f46-5286b4ecdbb0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:05.904452 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-147bb087-40ac-4d91-9f46-5286b4ecdbb0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:06.124113 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fe48a1cc-de43-4f5a-85eb-6e5c51c38124 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:06.129295 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-147bb087-40ac-4d91-9f46-5286b4ecdbb0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:06.133233 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fe48a1cc-de43-4f5a-85eb-6e5c51c38124 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.257045 Jun 15 10:19:06.142523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-147bb087-40ac-4d91-9f46-5286b4ecdbb0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.263974 Jun 15 10:19:06.143288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 381/766] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:05 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:06.146849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 386/767] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:05 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:06.148410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:06.149089 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:06.155402 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:06.155967 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:06.156809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:06.157313 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:06.287261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:06.295434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:06.297501 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:06.298675 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-493ab9e6-7115-4099-a40c-7a55b4f5bf8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.154139 Jun 15 10:19:06.299229 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 382/768] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:06 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:07.151070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2ba3b8cc-e706-47e1-a1c6-d651318971d9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:07.152353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2ba3b8cc-e706-47e1-a1c6-d651318971d9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:07.154447 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3616da77-4152-4526-a5c8-7c24cb79cf0b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:07.155059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3616da77-4152-4526-a5c8-7c24cb79cf0b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:07.160682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ba3b8cc-e706-47e1-a1c6-d651318971d9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:07.161139 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ba3b8cc-e706-47e1-a1c6-d651318971d9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:07.161833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3616da77-4152-4526-a5c8-7c24cb79cf0b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:07.161956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ba3b8cc-e706-47e1-a1c6-d651318971d9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:07.162302 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3616da77-4152-4526-a5c8-7c24cb79cf0b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:07.162434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2ba3b8cc-e706-47e1-a1c6-d651318971d9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:07.163059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3616da77-4152-4526-a5c8-7c24cb79cf0b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:07.163559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3616da77-4152-4526-a5c8-7c24cb79cf0b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:07.362933 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2ba3b8cc-e706-47e1-a1c6-d651318971d9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:07.366834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3616da77-4152-4526-a5c8-7c24cb79cf0b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:07.370380 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2ba3b8cc-e706-47e1-a1c6-d651318971d9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.223939 Jun 15 10:19:07.370896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 387/769] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:07 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:07.375070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3616da77-4152-4526-a5c8-7c24cb79cf0b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.224002 Jun 15 10:19:07.375815 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:07.379951 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 383/770] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:07 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:07.380076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:07.382401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:07.382864 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:07.383773 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:07.384220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:07.524259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:07.533428 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:07.535021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:07.536180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a4464312-f000-40e3-92ee-305033d36dd4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.164380 Jun 15 10:19:07.536733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 388/771] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:07 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:08.387730 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-55ebead3-b201-45b6-8f9c-24c972bc1249 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:08.388356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-55ebead3-b201-45b6-8f9c-24c972bc1249 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:08.393266 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2c89069f-afe2-47e4-bc11-3738aabae7c0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:08.393890 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2c89069f-afe2-47e4-bc11-3738aabae7c0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:08.395771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55ebead3-b201-45b6-8f9c-24c972bc1249 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:08.396225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55ebead3-b201-45b6-8f9c-24c972bc1249 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:08.397002 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55ebead3-b201-45b6-8f9c-24c972bc1249 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:08.397451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-55ebead3-b201-45b6-8f9c-24c972bc1249 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:08.400235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c89069f-afe2-47e4-bc11-3738aabae7c0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:08.400728 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c89069f-afe2-47e4-bc11-3738aabae7c0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:08.402718 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c89069f-afe2-47e4-bc11-3738aabae7c0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:08.403187 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c89069f-afe2-47e4-bc11-3738aabae7c0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:08.590301 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-55ebead3-b201-45b6-8f9c-24c972bc1249 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:08.598729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-55ebead3-b201-45b6-8f9c-24c972bc1249 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.214921 Jun 15 10:19:08.609349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 384/772] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:08 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:08.615341 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:08.616074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:08.621538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2c89069f-afe2-47e4-bc11-3738aabae7c0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:08.622538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:08.623043 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:08.623907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:08.624925 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:08.631527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2c89069f-afe2-47e4-bc11-3738aabae7c0 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.243272 Jun 15 10:19:08.635959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 389/773] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:08 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:08.773018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:08.781344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:08.782909 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:08.784051 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-535be1d6-4764-411b-ad42-f192d2030b7e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.173557 Jun 15 10:19:08.784616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 385/774] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:08 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:09.615693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-93d929c0-2cd2-48c6-9f8c-6ba6932949ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:09.616312 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-93d929c0-2cd2-48c6-9f8c-6ba6932949ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:09.622755 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93d929c0-2cd2-48c6-9f8c-6ba6932949ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:09.623200 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93d929c0-2cd2-48c6-9f8c-6ba6932949ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:09.623959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93d929c0-2cd2-48c6-9f8c-6ba6932949ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:09.624397 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93d929c0-2cd2-48c6-9f8c-6ba6932949ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:09.649356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6d8357cd-47f7-4d92-83d5-79966840e92f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:09.649988 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6d8357cd-47f7-4d92-83d5-79966840e92f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:09.657304 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d8357cd-47f7-4d92-83d5-79966840e92f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:09.657774 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d8357cd-47f7-4d92-83d5-79966840e92f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:09.658663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d8357cd-47f7-4d92-83d5-79966840e92f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:09.659108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6d8357cd-47f7-4d92-83d5-79966840e92f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:09.826148 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-93d929c0-2cd2-48c6-9f8c-6ba6932949ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:09.835152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-93d929c0-2cd2-48c6-9f8c-6ba6932949ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.223211 Jun 15 10:19:09.835923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 390/775] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:09 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:09.840771 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:09.841448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:09.850112 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:09.850903 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:09.851272 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6d8357cd-47f7-4d92-83d5-79966840e92f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:09.851671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:09.852104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:09.858716 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6d8357cd-47f7-4d92-83d5-79966840e92f tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.213120 Jun 15 10:19:09.859490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 386/776] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:09 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:09.997946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:10.007743 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:10.009744 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:10.011038 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dfd399bc-788c-47fb-971b-b0e0f81ba1c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.174136 Jun 15 10:19:10.014317 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 391/777] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:09 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:10.852717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-61dbc008-e144-4b88-8b5b-16fe63550ed8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:10.853326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-61dbc008-e144-4b88-8b5b-16fe63550ed8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:10.860409 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-61dbc008-e144-4b88-8b5b-16fe63550ed8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:10.860880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-61dbc008-e144-4b88-8b5b-16fe63550ed8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:10.861631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-61dbc008-e144-4b88-8b5b-16fe63550ed8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:10.862061 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-61dbc008-e144-4b88-8b5b-16fe63550ed8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:10.875811 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a529f85e-f686-4a5a-9cc9-8ff325e5d6c1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:10.876344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a529f85e-f686-4a5a-9cc9-8ff325e5d6c1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:10.883095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a529f85e-f686-4a5a-9cc9-8ff325e5d6c1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:10.883586 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a529f85e-f686-4a5a-9cc9-8ff325e5d6c1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:10.884359 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a529f85e-f686-4a5a-9cc9-8ff325e5d6c1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:10.884800 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a529f85e-f686-4a5a-9cc9-8ff325e5d6c1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:11.133424 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-61dbc008-e144-4b88-8b5b-16fe63550ed8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:11.148281 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a529f85e-f686-4a5a-9cc9-8ff325e5d6c1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:11.161336 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-61dbc008-e144-4b88-8b5b-16fe63550ed8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.312617 Jun 15 10:19:11.170657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 387/778] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:10 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:11.170657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:11.170657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:11.174738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:11.174883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a529f85e-f686-4a5a-9cc9-8ff325e5d6c1 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.302903 Jun 15 10:19:11.175195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:11.175431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 392/779] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:10 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:11.175978 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:11.176416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:11.336053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:11.345567 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:11.347109 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:11.348265 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f32e9f11-d985-433a-8982-13a89bd49be8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.185231 Jun 15 10:19:11.348829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 388/780] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:11 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:12.178663 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-eebf7065-18de-4821-bb95-4446f7e5c807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:12.179269 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-eebf7065-18de-4821-bb95-4446f7e5c807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:12.185753 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-eebf7065-18de-4821-bb95-4446f7e5c807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:12.186201 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-eebf7065-18de-4821-bb95-4446f7e5c807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:12.187756 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-eebf7065-18de-4821-bb95-4446f7e5c807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:12.188244 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-eebf7065-18de-4821-bb95-4446f7e5c807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:12.192219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4e71c005-14ee-43c1-8903-65e70b72f78a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:12.192840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4e71c005-14ee-43c1-8903-65e70b72f78a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:12.199189 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e71c005-14ee-43c1-8903-65e70b72f78a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:12.199641 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e71c005-14ee-43c1-8903-65e70b72f78a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:12.200410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e71c005-14ee-43c1-8903-65e70b72f78a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:12.200851 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e71c005-14ee-43c1-8903-65e70b72f78a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:12.395064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-eebf7065-18de-4821-bb95-4446f7e5c807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:12.399221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4e71c005-14ee-43c1-8903-65e70b72f78a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:12.403383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-eebf7065-18de-4821-bb95-4446f7e5c807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.228768 Jun 15 10:19:12.404070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 393/781] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:12 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:12.407108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4e71c005-14ee-43c1-8903-65e70b72f78a tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.218630 Jun 15 10:19:12.407799 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 389/782] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:12 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:12.409922 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:12.410631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:12.419368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:12.420148 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:12.421622 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:12.422417 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:12.565314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:12.573557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:12.575071 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:12.576209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-38b2a1fc-b8ea-4e66-8219-89dba78276a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.171162 Jun 15 10:19:12.576767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 394/783] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:12 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:13.421914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-830c3f78-0bce-4231-b11e-56139264505c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:13.422627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-830c3f78-0bce-4231-b11e-56139264505c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:13.424289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0dbc42fc-7181-4240-9bd8-121e5731fa1b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:13.424902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0dbc42fc-7181-4240-9bd8-121e5731fa1b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:13.427788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=62 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:13.430777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-830c3f78-0bce-4231-b11e-56139264505c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:13.431328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-830c3f78-0bce-4231-b11e-56139264505c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:13.432376 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-830c3f78-0bce-4231-b11e-56139264505c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:13.432969 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-830c3f78-0bce-4231-b11e-56139264505c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:13.433586 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbc42fc-7181-4240-9bd8-121e5731fa1b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:13.434046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbc42fc-7181-4240-9bd8-121e5731fa1b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:13.434849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbc42fc-7181-4240-9bd8-121e5731fa1b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:13.435291 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0dbc42fc-7181-4240-9bd8-121e5731fa1b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:13.624497 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-830c3f78-0bce-4231-b11e-56139264505c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:13.631116 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0dbc42fc-7181-4240-9bd8-121e5731fa1b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:13.632041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-830c3f78-0bce-4231-b11e-56139264505c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.214309 Jun 15 10:19:13.632626 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 390/784] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:13 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:13.637250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0f1d3291-f703-4ce3-aa89-59abb6cb5107 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:13.637746 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0f1d3291-f703-4ce3-aa89-59abb6cb5107 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:13.638789 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0dbc42fc-7181-4240-9bd8-121e5731fa1b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.218342 Jun 15 10:19:13.642768 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 395/785] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:13 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:13.644916 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f1d3291-f703-4ce3-aa89-59abb6cb5107 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:13.645082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:13.645435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f1d3291-f703-4ce3-aa89-59abb6cb5107 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:13.645690 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:13.646212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f1d3291-f703-4ce3-aa89-59abb6cb5107 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:13.646680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f1d3291-f703-4ce3-aa89-59abb6cb5107 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:13.651456 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:13.651905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:13.652672 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:13.653107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:13.661196 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:13.671854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0f1d3291-f703-4ce3-aa89-59abb6cb5107 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/ips" status: 200 len: 145 microversion: 2.1 time: 0.038234 Jun 15 10:19:13.672490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 391/786] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:19:13 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:13.790117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:13.799846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:13.801325 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:13.802535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b730344e-c14d-4b96-aa0b-8ae8cbc6b979 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.161230 Jun 15 10:19:13.803088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 396/787] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:13 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:14.650989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-591d956f-d37f-4872-a486-566b722c87cf tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:14.663932 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-591d956f-d37f-4872-a486-566b722c87cf tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:14.664183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b479ae26-c3a1-48df-8657-38d37e9639d2 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:14.664183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b479ae26-c3a1-48df-8657-38d37e9639d2 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:14.664730 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-591d956f-d37f-4872-a486-566b722c87cf tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:14.664730 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-591d956f-d37f-4872-a486-566b722c87cf tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:14.664730 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-591d956f-d37f-4872-a486-566b722c87cf tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:14.664730 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-591d956f-d37f-4872-a486-566b722c87cf tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:14.667294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b479ae26-c3a1-48df-8657-38d37e9639d2 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:14.667823 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b479ae26-c3a1-48df-8657-38d37e9639d2 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:14.670117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b479ae26-c3a1-48df-8657-38d37e9639d2 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:14.670608 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b479ae26-c3a1-48df-8657-38d37e9639d2 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:14.694787 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:14.861626 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-591d956f-d37f-4872-a486-566b722c87cf tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:14.865194 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b479ae26-c3a1-48df-8657-38d37e9639d2 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:14.869356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-591d956f-d37f-4872-a486-566b722c87cf tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.223673 Jun 15 10:19:14.870012 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 392/788] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:14 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:14.872694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b479ae26-c3a1-48df-8657-38d37e9639d2 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.220422 Jun 15 10:19:14.873420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 397/789] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:14 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:14.875701 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:14.876375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:14.882256 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:14.882813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:14.883583 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:14.884018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:15.012570 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:15.021473 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:15.023009 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:15.024169 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7af57780-30f5-4369-85c3-db1fb0e25380 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.153148 Jun 15 10:19:15.024728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 393/790] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:14 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:15.886395 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-13202613-a071-4cc6-bbb7-e0e969c3af12 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:15.887028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-13202613-a071-4cc6-bbb7-e0e969c3af12 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:15.890226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-47bd9456-8329-44a8-892f-71bb56f9bf51 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:15.891021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-47bd9456-8329-44a8-892f-71bb56f9bf51 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:15.895356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-13202613-a071-4cc6-bbb7-e0e969c3af12 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:15.895813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-13202613-a071-4cc6-bbb7-e0e969c3af12 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:15.896593 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-13202613-a071-4cc6-bbb7-e0e969c3af12 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:15.897029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-13202613-a071-4cc6-bbb7-e0e969c3af12 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:15.897308 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-47bd9456-8329-44a8-892f-71bb56f9bf51 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:15.897754 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-47bd9456-8329-44a8-892f-71bb56f9bf51 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:15.898543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-47bd9456-8329-44a8-892f-71bb56f9bf51 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:15.898971 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-47bd9456-8329-44a8-892f-71bb56f9bf51 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:16.089881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-13202613-a071-4cc6-bbb7-e0e969c3af12 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:16.094612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-47bd9456-8329-44a8-892f-71bb56f9bf51 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:16.098308 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-13202613-a071-4cc6-bbb7-e0e969c3af12 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.215794 Jun 15 10:19:16.098922 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 398/791] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:15 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:16.102532 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-47bd9456-8329-44a8-892f-71bb56f9bf51 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.216704 Jun 15 10:19:16.105371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 394/792] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:15 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:16.105624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:16.105624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:16.110569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:16.114308 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:16.114308 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:16.114308 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:16.242124 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:16.250691 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:16.252234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:16.253330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-941d021a-cc37-44ad-b64e-74609cab6c96 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.153498 Jun 15 10:19:16.253879 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 399/793] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:16 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:16.836244 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-167b865d-12ea-4fe2-aef2-43f6919e1028 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdfc2020-79a4-4d63-818f-fadf464dfcd4"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:16.837381 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-167b865d-12ea-4fe2-aef2-43f6919e1028 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:16.844185 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-167b865d-12ea-4fe2-aef2-43f6919e1028 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:16.845006 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-167b865d-12ea-4fe2-aef2-43f6919e1028 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:16.845672 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-167b865d-12ea-4fe2-aef2-43f6919e1028 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:16.845863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-167b865d-12ea-4fe2-aef2-43f6919e1028 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:17.122482 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-abc3f6b7-3ba9-4e76-ba54-280ab15d6a54 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:17.123139 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-abc3f6b7-3ba9-4e76-ba54-280ab15d6a54 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:17.132310 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-abc3f6b7-3ba9-4e76-ba54-280ab15d6a54 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:17.132775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-abc3f6b7-3ba9-4e76-ba54-280ab15d6a54 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:17.133562 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-abc3f6b7-3ba9-4e76-ba54-280ab15d6a54 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:17.134009 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-abc3f6b7-3ba9-4e76-ba54-280ab15d6a54 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:17.343882 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-abc3f6b7-3ba9-4e76-ba54-280ab15d6a54 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:17.352091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-abc3f6b7-3ba9-4e76-ba54-280ab15d6a54 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.236445 Jun 15 10:19:17.352740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 400/794] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:17 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:17.358513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-be949e15-5cb1-41af-a062-485fe1f114e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:17.359624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-be949e15-5cb1-41af-a062-485fe1f114e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:17.366452 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be949e15-5cb1-41af-a062-485fe1f114e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:17.366910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be949e15-5cb1-41af-a062-485fe1f114e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:17.367694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be949e15-5cb1-41af-a062-485fe1f114e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:17.368135 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-be949e15-5cb1-41af-a062-485fe1f114e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:17.502850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-be949e15-5cb1-41af-a062-485fe1f114e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:17.510587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-be949e15-5cb1-41af-a062-485fe1f114e8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.156593 Jun 15 10:19:17.511194 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 401/795] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:17 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:17.515811 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:17.516421 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:17.522957 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:17.523410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:17.524181 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:17.524621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:17.654187 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:17.663113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:17.664606 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:17.665752 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5c99924c-39e9-4182-ab30-8dd7133dbec0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.153654 Jun 15 10:19:17.666324 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 402/796] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:17 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:17.729050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-b999043d-4627-4e4f-9c7a-c5001913eaa0 req-bba6b05c-2593-413e-a9d8-26e91e123194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f24d77-e20b-448e-aa55-b4aa206c4abf", "tag": "7ed10135-626d-4a21-82fb-bafe20ebc074"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:17.737804 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-b999043d-4627-4e4f-9c7a-c5001913eaa0 req-bba6b05c-2593-413e-a9d8-26e91e123194 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:17.738255 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-b999043d-4627-4e4f-9c7a-c5001913eaa0 req-bba6b05c-2593-413e-a9d8-26e91e123194 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:17.748875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-b999043d-4627-4e4f-9c7a-c5001913eaa0 req-bba6b05c-2593-413e-a9d8-26e91e123194 service nova] Creating event network-changed:7ed10135-626d-4a21-82fb-bafe20ebc074 for instance 84f24d77-e20b-448e-aa55-b4aa206c4abf on hv-cinder-83028 Jun 15 10:19:17.753663 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-b999043d-4627-4e4f-9c7a-c5001913eaa0 req-bba6b05c-2593-413e-a9d8-26e91e123194 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086255 Jun 15 10:19:17.754232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 403/797] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:18.371614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-542348ff-15bf-4f6f-881c-5f39012782a3 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:18.372247 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-542348ff-15bf-4f6f-881c-5f39012782a3 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:18.379137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-542348ff-15bf-4f6f-881c-5f39012782a3 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:18.379584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-542348ff-15bf-4f6f-881c-5f39012782a3 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:18.380336 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-542348ff-15bf-4f6f-881c-5f39012782a3 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:18.380768 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-542348ff-15bf-4f6f-881c-5f39012782a3 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:18.511553 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-542348ff-15bf-4f6f-881c-5f39012782a3 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:18.519938 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-542348ff-15bf-4f6f-881c-5f39012782a3 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.153078 Jun 15 10:19:18.520535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 404/798] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:18 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:18.526853 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cc80d4bc-ff38-4629-b3e7-bb5f40cb43ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:18.527451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cc80d4bc-ff38-4629-b3e7-bb5f40cb43ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:18.533288 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc80d4bc-ff38-4629-b3e7-bb5f40cb43ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:18.533733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc80d4bc-ff38-4629-b3e7-bb5f40cb43ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:18.534507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc80d4bc-ff38-4629-b3e7-bb5f40cb43ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:18.534937 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc80d4bc-ff38-4629-b3e7-bb5f40cb43ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:18.661443 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cc80d4bc-ff38-4629-b3e7-bb5f40cb43ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:18.668865 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cc80d4bc-ff38-4629-b3e7-bb5f40cb43ef tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.145536 Jun 15 10:19:18.669437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 405/799] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:18 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:18.684099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:18.684700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:18.690926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:18.691374 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:18.692120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:18.692580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:18.822705 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:18.830972 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:18.832466 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:18.833615 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-938ba740-632e-485e-b1f6-9b64d11265ab tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.153044 Jun 15 10:19:18.834169 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 406/800] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:18 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:19:19.537452 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ce5b85c5-eb54-4237-b299-781fdbe6280b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:19.538128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ce5b85c5-eb54-4237-b299-781fdbe6280b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:19.544650 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ce5b85c5-eb54-4237-b299-781fdbe6280b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:19.545105 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ce5b85c5-eb54-4237-b299-781fdbe6280b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:19.545900 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ce5b85c5-eb54-4237-b299-781fdbe6280b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:19.546492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ce5b85c5-eb54-4237-b299-781fdbe6280b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:19.675068 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ce5b85c5-eb54-4237-b299-781fdbe6280b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:19.682519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ce5b85c5-eb54-4237-b299-781fdbe6280b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.148930 Jun 15 10:19:19.683088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 407/801] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:19 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:19.687504 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5877fe3e-7af3-4963-a8b1-fd8e2ce37917 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:19.688108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5877fe3e-7af3-4963-a8b1-fd8e2ce37917 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:19.693665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5877fe3e-7af3-4963-a8b1-fd8e2ce37917 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:19.694119 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5877fe3e-7af3-4963-a8b1-fd8e2ce37917 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:19.694908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5877fe3e-7af3-4963-a8b1-fd8e2ce37917 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:19.695350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5877fe3e-7af3-4963-a8b1-fd8e2ce37917 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:19.822009 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5877fe3e-7af3-4963-a8b1-fd8e2ce37917 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:19.830016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5877fe3e-7af3-4963-a8b1-fd8e2ce37917 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.145997 Jun 15 10:19:19.830612 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 408/802] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:19 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:19.851325 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:19.851934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:19.857660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:19.858150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:19.858953 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:19.859394 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:19.988827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:19.997149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:19.999159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:20.000441 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-97c5e6c2-d4b0-4ed2-a414-dff0dbb10bb0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.153050 Jun 15 10:19:20.000998 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 409/803] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:19 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:19:20.476287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-167b865d-12ea-4fe2-aef2-43f6919e1028 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.643408 Jun 15 10:19:20.491834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 395/804] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:19:16 2022] POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/os-volume_attachments => generated 194 bytes in 3659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:20.701434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d70b6217-26d3-4caa-b56b-d56c758f9f46 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:20.703067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d70b6217-26d3-4caa-b56b-d56c758f9f46 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:20.712289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d70b6217-26d3-4caa-b56b-d56c758f9f46 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:20.713286 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d70b6217-26d3-4caa-b56b-d56c758f9f46 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:20.714420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d70b6217-26d3-4caa-b56b-d56c758f9f46 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:20.715070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d70b6217-26d3-4caa-b56b-d56c758f9f46 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:20.855499 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f450c3f2-71e7-4820-9f3c-a18b8597a272 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:20.857325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f450c3f2-71e7-4820-9f3c-a18b8597a272 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:20.879091 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f450c3f2-71e7-4820-9f3c-a18b8597a272 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:20.879830 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f450c3f2-71e7-4820-9f3c-a18b8597a272 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:20.880963 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f450c3f2-71e7-4820-9f3c-a18b8597a272 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:20.881858 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f450c3f2-71e7-4820-9f3c-a18b8597a272 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:20.937101 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d70b6217-26d3-4caa-b56b-d56c758f9f46 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4fd4257ccd492a8ecf3dfb731cb142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6344b21c92314593b43addf9a8f21100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:20.948636 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d70b6217-26d3-4caa-b56b-d56c758f9f46 tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 200 len: 1515 microversion: 2.1 time: 0.251990 Jun 15 10:19:20.950524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 410/805] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:20 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:21.034117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-4625d2df-3021-4d4e-90ec-0c939888bd37 req-e1fe899d-0bef-432a-97e1-c2e4a9ddeb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf752fce-11a0-452b-8a60-58506c708350", "name": "network-vif-deleted", "tag": "7b5afd89-cb94-42ce-b94a-3ebec914a616"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:21.042778 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4625d2df-3021-4d4e-90ec-0c939888bd37 req-e1fe899d-0bef-432a-97e1-c2e4a9ddeb71 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:21.043502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4625d2df-3021-4d4e-90ec-0c939888bd37 req-e1fe899d-0bef-432a-97e1-c2e4a9ddeb71 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:21.055320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-4625d2df-3021-4d4e-90ec-0c939888bd37 req-e1fe899d-0bef-432a-97e1-c2e4a9ddeb71 service nova] Creating event network-vif-deleted:7b5afd89-cb94-42ce-b94a-3ebec914a616 for instance bf752fce-11a0-452b-8a60-58506c708350 on hv-cinder-83028 Jun 15 10:19:21.060710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-4625d2df-3021-4d4e-90ec-0c939888bd37 req-e1fe899d-0bef-432a-97e1-c2e4a9ddeb71 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108666 Jun 15 10:19:21.062197 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 411/806] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:21.063513 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f450c3f2-71e7-4820-9f3c-a18b8597a272 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:21.068638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:21.069617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:21.075367 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f450c3f2-71e7-4820-9f3c-a18b8597a272 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.231247 Jun 15 10:19:21.076125 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 396/807] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:20 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:21.083410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:21.083873 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:21.084713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:21.085164 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:21.237037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:21.245409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:21.246929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:21.248121 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cab7bae0-25b4-4a18-9f2e-a4993adce640 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.184569 Jun 15 10:19:21.249498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 412/808] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:21 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:21.967465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:21.968108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] [instance: bf752fce-11a0-452b-8a60-58506c708350] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:21.975623 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:21.976071 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:21.976831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:21.977268 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:21.991813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] HTTP exception thrown: Instance bf752fce-11a0-452b-8a60-58506c708350 could not be found. Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Request method failure captured: Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 HTTP/1.1 Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbE_XdcNsdJjaf4xo-uK49qEs8Cy--_OoQMgDi5oSgJTkKZ-5epRb-ulbMSbkFintTVCGR2u-eFw0E9sNdROrAmlTg1FXQUpKvb_E4FJnyjXpdfDAaK1ST0vhdJlMldB-cXPolq4wse2S4TBKUjh5msgE5-qeK6D-J5shFVhB-P0j2o Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 6344b21c92314593b43addf9a8f21100 Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2073755291 Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:19:21.993440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6344b21c92314593b43addf9a8f21100", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6344b21c92314593b43addf9a8f21100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6344b21c92314593b43addf9a8f21100"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6344b21c92314593b43addf9a8f21100"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-VolumesSnapshotTestJSON-2073755291 Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 6344b21c92314593b43addf9a8f21100 Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2073755291 Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-VolumesSnapshotTestJSON-2073755291-project Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 8c4fd4257ccd492a8ecf3dfb731cb142 Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-VolumesSnapshotTestJSON-2073755291-project Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance bf752fce-11a0-452b-8a60-58506c708350 could not be found. Jun 15 10:19:21.995035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'bf752fce-11a0-452b-8a60-58506c708350'} Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf752fce-11a0-452b-8a60-58506c708350 could not be found. Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:19:21.995930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf752fce-11a0-452b-8a60-58506c708350 could not be found. Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf752fce-11a0-452b-8a60-58506c708350 could not be found. Jun 15 10:19:21.997380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:19:21.998784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] Returning 404 to user: Instance bf752fce-11a0-452b-8a60-58506c708350 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:19:21.998784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-548a551b-e91b-4b3d-b751-73885f57056b tempest-VolumesSnapshotTestJSON-2073755291 tempest-VolumesSnapshotTestJSON-2073755291-project] 10.222.0.57 "GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350" status: 404 len: 111 microversion: 2.1 time: 0.031243 Jun 15 10:19:21.998784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 397/809] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:21 2022] GET /compute/v2.1/servers/bf752fce-11a0-452b-8a60-58506c708350 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:19:22.091894 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-89552834-c702-4219-8c2e-716ab679147e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:22.092608 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-89552834-c702-4219-8c2e-716ab679147e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:22.102688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89552834-c702-4219-8c2e-716ab679147e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:22.103899 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89552834-c702-4219-8c2e-716ab679147e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:22.104753 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89552834-c702-4219-8c2e-716ab679147e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:22.105203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89552834-c702-4219-8c2e-716ab679147e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:22.241431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-89552834-c702-4219-8c2e-716ab679147e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:22.250087 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-89552834-c702-4219-8c2e-716ab679147e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.161394 Jun 15 10:19:22.250710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 413/810] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:22 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:22.275603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:22.275603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:22.275874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:22.276473 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:22.277249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:22.277683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:22.412987 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:22.421267 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:22.422949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:22.424097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5d4d02f8-5d91-4ea1-85ad-8a60129f7414 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.160322 Jun 15 10:19:22.424645 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 398/811] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:22 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:23.267493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3dca0718-1d77-4f63-9471-819e16475047 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:23.268103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3dca0718-1d77-4f63-9471-819e16475047 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:23.274667 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3dca0718-1d77-4f63-9471-819e16475047 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:23.275111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3dca0718-1d77-4f63-9471-819e16475047 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:23.275943 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3dca0718-1d77-4f63-9471-819e16475047 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:23.277903 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3dca0718-1d77-4f63-9471-819e16475047 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:23.419845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3dca0718-1d77-4f63-9471-819e16475047 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:23.427527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3dca0718-1d77-4f63-9471-819e16475047 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.164562 Jun 15 10:19:23.428309 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 414/812] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:23 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:23.444438 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:23.445536 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:23.454293 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:23.454793 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:23.455591 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:23.456040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:23.475103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:23.497327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-80318329-73d0-482f-8a39-2884d819757a req-7eb01ab7-4459-4ea3-81b3-6c8f1e14fb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5ab626-a7eb-407e-b8a9-a768e57d4022", "name": "network-vif-plugged", "status": "completed", "tag": "2021b47d-9010-4d70-8020-0269285a0559"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:23.507734 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-80318329-73d0-482f-8a39-2884d819757a req-7eb01ab7-4459-4ea3-81b3-6c8f1e14fb36 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:23.508570 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-80318329-73d0-482f-8a39-2884d819757a req-7eb01ab7-4459-4ea3-81b3-6c8f1e14fb36 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:23.528477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-80318329-73d0-482f-8a39-2884d819757a req-7eb01ab7-4459-4ea3-81b3-6c8f1e14fb36 service nova] Creating event network-vif-plugged:2021b47d-9010-4d70-8020-0269285a0559 for instance af5ab626-a7eb-407e-b8a9-a768e57d4022 on hv-cinder-83028 Jun 15 10:19:23.534534 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-80318329-73d0-482f-8a39-2884d819757a req-7eb01ab7-4459-4ea3-81b3-6c8f1e14fb36 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117161 Jun 15 10:19:23.535667 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 399/813] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:19:23.619283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:23.627749 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:23.629231 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:23.630412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7d04c0a6-3973-4e99-ad04-30777f574072 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.191654 Jun 15 10:19:23.630963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 415/814] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:23 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:24.444521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f26c1ce2-ac02-4627-903f-b3f04d36df03 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:24.445264 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f26c1ce2-ac02-4627-903f-b3f04d36df03 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:24.452265 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f26c1ce2-ac02-4627-903f-b3f04d36df03 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:24.452901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f26c1ce2-ac02-4627-903f-b3f04d36df03 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:24.453800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f26c1ce2-ac02-4627-903f-b3f04d36df03 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:24.454243 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f26c1ce2-ac02-4627-903f-b3f04d36df03 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:24.586593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f26c1ce2-ac02-4627-903f-b3f04d36df03 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:24.595086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f26c1ce2-ac02-4627-903f-b3f04d36df03 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.155313 Jun 15 10:19:24.595655 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 400/815] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:24 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:24.648274 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:24.648889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:24.655353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:24.656605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:24.657368 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:24.657809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:24.795009 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:24.804519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:24.806037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:24.807238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-92c50896-8bc3-4b4f-9ee2-86e15b4dd6f0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.162855 Jun 15 10:19:24.807798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 416/816] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:24 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:25.612228 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cbd70484-43c1-4139-88c4-41f074563993 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:25.612835 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cbd70484-43c1-4139-88c4-41f074563993 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:25.619279 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cbd70484-43c1-4139-88c4-41f074563993 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:25.619722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cbd70484-43c1-4139-88c4-41f074563993 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:25.620473 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cbd70484-43c1-4139-88c4-41f074563993 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:25.620903 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cbd70484-43c1-4139-88c4-41f074563993 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:25.752542 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cbd70484-43c1-4139-88c4-41f074563993 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:25.759830 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cbd70484-43c1-4139-88c4-41f074563993 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.152005 Jun 15 10:19:25.760389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 401/817] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:25 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:25.828768 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:25.829536 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:25.836058 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:25.836505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:25.837268 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:25.837703 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:25.967492 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:25.976521 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:25.978003 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:25.979164 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-144b73ec-cc95-43be-913a-c01c2c1b860d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.154381 Jun 15 10:19:25.979719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 417/818] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:25 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:26.776826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-21725995-47b2-42ef-91fa-d88d27143b58 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:26.777426 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-21725995-47b2-42ef-91fa-d88d27143b58 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:26.784169 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21725995-47b2-42ef-91fa-d88d27143b58 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:26.784659 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21725995-47b2-42ef-91fa-d88d27143b58 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:26.785371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21725995-47b2-42ef-91fa-d88d27143b58 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:26.785807 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21725995-47b2-42ef-91fa-d88d27143b58 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:26.933241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-21725995-47b2-42ef-91fa-d88d27143b58 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:26.940980 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-21725995-47b2-42ef-91fa-d88d27143b58 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.168077 Jun 15 10:19:26.941535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 402/819] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:26 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:26.997404 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:26.998010 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:27.005038 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:27.005486 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:27.006240 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:27.006699 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:27.143807 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:27.152745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:27.154258 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:27.156026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e3fee75d-4b8f-4b12-8140-9aeba24a96fa tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.161873 Jun 15 10:19:27.156147 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 418/820] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:26 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:27.958120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d7835852-c4cb-47ba-ac86-53e1f0196402 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:27.959377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d7835852-c4cb-47ba-ac86-53e1f0196402 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:27.974407 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7835852-c4cb-47ba-ac86-53e1f0196402 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:27.974862 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7835852-c4cb-47ba-ac86-53e1f0196402 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:27.975892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7835852-c4cb-47ba-ac86-53e1f0196402 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:27.976328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7835852-c4cb-47ba-ac86-53e1f0196402 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:28.101576 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d7835852-c4cb-47ba-ac86-53e1f0196402 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:28.109099 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d7835852-c4cb-47ba-ac86-53e1f0196402 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.155387 Jun 15 10:19:28.109762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 403/821] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:27 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:28.172850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:28.173386 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:28.180017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:28.180482 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:28.181262 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:28.181749 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:28.319900 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:28.329185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:28.330769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:28.331966 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1041efb9-443a-4d22-aad1-fa86643057d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.163168 Jun 15 10:19:28.332534 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 419/822] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:28 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:29.124980 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f5f096b6-ee92-4e7f-92da-fade7e681b4c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:29.125620 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f5f096b6-ee92-4e7f-92da-fade7e681b4c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:29.132058 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5f096b6-ee92-4e7f-92da-fade7e681b4c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:29.132581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5f096b6-ee92-4e7f-92da-fade7e681b4c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:29.133338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5f096b6-ee92-4e7f-92da-fade7e681b4c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:29.133770 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5f096b6-ee92-4e7f-92da-fade7e681b4c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:29.271063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f5f096b6-ee92-4e7f-92da-fade7e681b4c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:29.278639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f5f096b6-ee92-4e7f-92da-fade7e681b4c tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.157584 Jun 15 10:19:29.279204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 404/823] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:29 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:29.349847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:29.350813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:29.357469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:29.357927 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:29.358959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:29.359292 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:29.494207 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:29.502968 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:29.504466 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:29.505612 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4ae94bdc-68a5-40db-8bf3-5eb28984ea9b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.159604 Jun 15 10:19:29.506167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 420/824] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:29 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:30.296667 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e44f52f5-c084-4a21-aea6-e91d587057ba tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:30.297378 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e44f52f5-c084-4a21-aea6-e91d587057ba tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:30.303766 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e44f52f5-c084-4a21-aea6-e91d587057ba tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:30.304206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e44f52f5-c084-4a21-aea6-e91d587057ba tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:30.304961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e44f52f5-c084-4a21-aea6-e91d587057ba tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:30.305393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e44f52f5-c084-4a21-aea6-e91d587057ba tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:30.434791 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e44f52f5-c084-4a21-aea6-e91d587057ba tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:30.442866 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e44f52f5-c084-4a21-aea6-e91d587057ba tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.150714 Jun 15 10:19:30.443436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 405/825] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:30 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:30.525225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:30.525882 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:30.532990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:30.533497 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:30.534539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:30.535092 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:30.677012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:30.685519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:30.687610 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:30.688783 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6eaaf685-4028-4e86-b9bd-4fe4f5635e29 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.167716 Jun 15 10:19:30.689377 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 421/826] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:30 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:30.771460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-a0ef3a29-5ff1-4ff6-9629-e0fce6eeed6a req-28954657-a657-42df-8484-ffd56c2a24cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f24d77-e20b-448e-aa55-b4aa206c4abf", "name": "network-vif-plugged", "status": "completed", "tag": "7ed10135-626d-4a21-82fb-bafe20ebc074"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:30.775207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:30.781539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a0ef3a29-5ff1-4ff6-9629-e0fce6eeed6a req-28954657-a657-42df-8484-ffd56c2a24cf service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:30.782180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a0ef3a29-5ff1-4ff6-9629-e0fce6eeed6a req-28954657-a657-42df-8484-ffd56c2a24cf service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:30.800469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-a0ef3a29-5ff1-4ff6-9629-e0fce6eeed6a req-28954657-a657-42df-8484-ffd56c2a24cf service nova] Creating event network-vif-plugged:7ed10135-626d-4a21-82fb-bafe20ebc074 for instance 84f24d77-e20b-448e-aa55-b4aa206c4abf on hv-cinder-83028 Jun 15 10:19:30.805470 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-a0ef3a29-5ff1-4ff6-9629-e0fce6eeed6a req-28954657-a657-42df-8484-ffd56c2a24cf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037611 Jun 15 10:19:30.806215 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 406/827] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:31.461331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9707277a-8edc-4f8f-b977-7aa971c68712 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:31.462111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9707277a-8edc-4f8f-b977-7aa971c68712 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:31.470872 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9707277a-8edc-4f8f-b977-7aa971c68712 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:31.473202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9707277a-8edc-4f8f-b977-7aa971c68712 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:31.475321 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9707277a-8edc-4f8f-b977-7aa971c68712 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:31.478192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9707277a-8edc-4f8f-b977-7aa971c68712 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:31.628002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9707277a-8edc-4f8f-b977-7aa971c68712 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:31.635595 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9707277a-8edc-4f8f-b977-7aa971c68712 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.179061 Jun 15 10:19:31.636167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 422/828] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:31 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:31.707322 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:31.708037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:31.714257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:31.714737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:31.715507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:31.715949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:31.847048 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:31.855608 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:31.857148 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:31.859686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1a5436fc-73f7-48cc-9a19-3ec00846ac91 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.155848 Jun 15 10:19:31.860257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 407/829] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:31 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:32.268822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ba04cb8b-4039-46c3-b42a-a761dc66d331 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:32.276611 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba04cb8b-4039-46c3-b42a-a761dc66d331 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:32.277358 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba04cb8b-4039-46c3-b42a-a761dc66d331 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:32.339449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ba04cb8b-4039-46c3-b42a-a761dc66d331 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Going to try to stop instance {{(pid=117720) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 10:19:32.381130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ba04cb8b-4039-46c3-b42a-a761dc66d331 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/action" status: 202 len: 0 microversion: 2.1 time: 0.116581 Jun 15 10:19:32.381666 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 423/830] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:19:32 2022] POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:19:32.390340 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b6bba2c4-d984-44e3-af75-e6cfd49cf9a2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:32.390947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b6bba2c4-d984-44e3-af75-e6cfd49cf9a2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:32.396865 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6bba2c4-d984-44e3-af75-e6cfd49cf9a2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:32.397314 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6bba2c4-d984-44e3-af75-e6cfd49cf9a2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:32.398062 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6bba2c4-d984-44e3-af75-e6cfd49cf9a2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:32.398523 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6bba2c4-d984-44e3-af75-e6cfd49cf9a2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:32.528516 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b6bba2c4-d984-44e3-af75-e6cfd49cf9a2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:32.537125 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b6bba2c4-d984-44e3-af75-e6cfd49cf9a2 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.151141 Jun 15 10:19:32.537690 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 408/831] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:32 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:32.652046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9423da82-94b5-4db8-9d2a-8bce4229af35 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:32.652755 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9423da82-94b5-4db8-9d2a-8bce4229af35 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:32.659663 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9423da82-94b5-4db8-9d2a-8bce4229af35 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:32.660141 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9423da82-94b5-4db8-9d2a-8bce4229af35 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:32.660881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9423da82-94b5-4db8-9d2a-8bce4229af35 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:32.661319 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9423da82-94b5-4db8-9d2a-8bce4229af35 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:32.787703 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9423da82-94b5-4db8-9d2a-8bce4229af35 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:32.794988 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9423da82-94b5-4db8-9d2a-8bce4229af35 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.147162 Jun 15 10:19:32.795557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 424/832] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:32 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:32.878387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:32.879029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:32.885422 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:32.885873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:32.886657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:32.887096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:32.892260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:33.022571 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:33.031736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:33.033359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:33.034567 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-03745003-027d-4f71-a6d4-f845e5c92e28 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.160931 Jun 15 10:19:33.035140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 409/833] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:32 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:33.554934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9345765b-278e-4295-8caf-039deb805beb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:33.555590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9345765b-278e-4295-8caf-039deb805beb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:33.562644 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9345765b-278e-4295-8caf-039deb805beb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:33.563100 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9345765b-278e-4295-8caf-039deb805beb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:33.563876 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9345765b-278e-4295-8caf-039deb805beb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:33.564322 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9345765b-278e-4295-8caf-039deb805beb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:33.696739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9345765b-278e-4295-8caf-039deb805beb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:33.705538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9345765b-278e-4295-8caf-039deb805beb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.154478 Jun 15 10:19:33.706335 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 425/834] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:33 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:33.812777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-510ae1a4-d5f0-499b-93c7-a29978da5bcd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:33.813496 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-510ae1a4-d5f0-499b-93c7-a29978da5bcd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:33.820055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-510ae1a4-d5f0-499b-93c7-a29978da5bcd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:33.820505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-510ae1a4-d5f0-499b-93c7-a29978da5bcd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:33.821271 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-510ae1a4-d5f0-499b-93c7-a29978da5bcd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:33.821725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-510ae1a4-d5f0-499b-93c7-a29978da5bcd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:33.956661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-510ae1a4-d5f0-499b-93c7-a29978da5bcd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:33.964699 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-510ae1a4-d5f0-499b-93c7-a29978da5bcd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.156702 Jun 15 10:19:33.965269 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 410/835] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:33 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:34.052781 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:34.053323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:34.059267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:34.059727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:34.060490 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:34.060930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:34.189512 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:34.197846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:34.199391 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:34.200549 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7248f7c7-b1d2-479e-a1ce-87710ddc722f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.151692 Jun 15 10:19:34.201111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 426/836] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:34 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:34.722811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4a6e616e-25e1-4a79-a596-3567e47b1bc7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:34.723432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4a6e616e-25e1-4a79-a596-3567e47b1bc7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:34.729637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4a6e616e-25e1-4a79-a596-3567e47b1bc7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:34.730092 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4a6e616e-25e1-4a79-a596-3567e47b1bc7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:34.730886 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4a6e616e-25e1-4a79-a596-3567e47b1bc7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:34.731331 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4a6e616e-25e1-4a79-a596-3567e47b1bc7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:34.872789 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4a6e616e-25e1-4a79-a596-3567e47b1bc7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:34.880847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4a6e616e-25e1-4a79-a596-3567e47b1bc7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.161897 Jun 15 10:19:34.881415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 411/837] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:34 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:34.981805 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7dd6f054-470c-49e4-aa92-bc73acab272e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:34.982344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7dd6f054-470c-49e4-aa92-bc73acab272e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:34.989511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7dd6f054-470c-49e4-aa92-bc73acab272e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:34.989962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7dd6f054-470c-49e4-aa92-bc73acab272e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:34.990751 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7dd6f054-470c-49e4-aa92-bc73acab272e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:34.991195 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7dd6f054-470c-49e4-aa92-bc73acab272e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:35.121724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7dd6f054-470c-49e4-aa92-bc73acab272e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:35.129802 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7dd6f054-470c-49e4-aa92-bc73acab272e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.151820 Jun 15 10:19:35.130383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 427/838] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:34 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:35.220154 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:35.220768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:35.227500 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:35.227950 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:35.228742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:35.229161 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:35.356883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:35.365195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:35.366732 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:35.367894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-df5fcedd-a0bc-4468-a48b-f608a1dd35b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.152350 Jun 15 10:19:35.368459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 412/839] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:35 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:35.898155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-28e167b2-c11b-466c-897a-545376be6e3e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:35.898803 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-28e167b2-c11b-466c-897a-545376be6e3e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:35.905412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28e167b2-c11b-466c-897a-545376be6e3e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:35.905969 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28e167b2-c11b-466c-897a-545376be6e3e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:35.906776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28e167b2-c11b-466c-897a-545376be6e3e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:35.907218 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28e167b2-c11b-466c-897a-545376be6e3e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:36.040735 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-28e167b2-c11b-466c-897a-545376be6e3e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:36.048527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-28e167b2-c11b-466c-897a-545376be6e3e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.154302 Jun 15 10:19:36.049085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 428/840] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:35 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:36.147386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-044838dc-80e7-464c-91c2-9fbdfab1efc7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:36.148029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-044838dc-80e7-464c-91c2-9fbdfab1efc7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:36.154055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-044838dc-80e7-464c-91c2-9fbdfab1efc7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:36.154535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-044838dc-80e7-464c-91c2-9fbdfab1efc7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:36.155875 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-044838dc-80e7-464c-91c2-9fbdfab1efc7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:36.156308 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-044838dc-80e7-464c-91c2-9fbdfab1efc7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:36.279072 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-044838dc-80e7-464c-91c2-9fbdfab1efc7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:36.286933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-044838dc-80e7-464c-91c2-9fbdfab1efc7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.143350 Jun 15 10:19:36.287502 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 413/841] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:36 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:36.386217 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:36.386875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:36.393448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:36.393888 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:36.394668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:36.395101 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:36.524652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:36.533033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:36.534569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:36.535717 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9edede0e-502a-4784-967a-3fd72892fbbd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.153309 Jun 15 10:19:36.536266 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 429/842] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:36 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:37.066487 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-82abe3b8-4e29-464d-9e4a-35908480c62e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:37.067138 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-82abe3b8-4e29-464d-9e4a-35908480c62e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:37.073410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82abe3b8-4e29-464d-9e4a-35908480c62e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:37.073860 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82abe3b8-4e29-464d-9e4a-35908480c62e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:37.074658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82abe3b8-4e29-464d-9e4a-35908480c62e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:37.075100 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-82abe3b8-4e29-464d-9e4a-35908480c62e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:37.204464 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-82abe3b8-4e29-464d-9e4a-35908480c62e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:37.212356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-82abe3b8-4e29-464d-9e4a-35908480c62e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.150849 Jun 15 10:19:37.212924 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 414/843] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:37 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:37.303347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bc2f3b75-215f-459b-a0b5-06375adcfeae tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:37.303966 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bc2f3b75-215f-459b-a0b5-06375adcfeae tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:37.310428 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc2f3b75-215f-459b-a0b5-06375adcfeae tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:37.311130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc2f3b75-215f-459b-a0b5-06375adcfeae tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:37.312058 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc2f3b75-215f-459b-a0b5-06375adcfeae tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:37.312502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc2f3b75-215f-459b-a0b5-06375adcfeae tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:37.440657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bc2f3b75-215f-459b-a0b5-06375adcfeae tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:37.447834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bc2f3b75-215f-459b-a0b5-06375adcfeae tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.148296 Jun 15 10:19:37.448400 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 430/844] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:37 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:37.553627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:37.554231 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:37.560552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:37.561097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:37.561846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:37.562295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:37.695425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:37.704415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:37.705922 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:37.707111 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1b2021a5-f7d9-47e2-91ef-13c651e6751f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.157323 Jun 15 10:19:37.707673 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 415/845] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:37 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:19:38.230626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dc48f319-48ed-4bdb-9abc-a8cb98b801f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:38.231159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dc48f319-48ed-4bdb-9abc-a8cb98b801f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:38.238240 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc48f319-48ed-4bdb-9abc-a8cb98b801f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:38.238721 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc48f319-48ed-4bdb-9abc-a8cb98b801f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:38.239485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc48f319-48ed-4bdb-9abc-a8cb98b801f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:38.239925 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc48f319-48ed-4bdb-9abc-a8cb98b801f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:38.242566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:38.373952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dc48f319-48ed-4bdb-9abc-a8cb98b801f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:38.382255 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dc48f319-48ed-4bdb-9abc-a8cb98b801f5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.155717 Jun 15 10:19:38.382848 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 431/846] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:38 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:38.465002 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-217fa54d-5ad0-4ef1-8195-8ebe7f993c65 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:38.465599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-217fa54d-5ad0-4ef1-8195-8ebe7f993c65 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:38.472197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-217fa54d-5ad0-4ef1-8195-8ebe7f993c65 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:38.472649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-217fa54d-5ad0-4ef1-8195-8ebe7f993c65 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:38.473398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-217fa54d-5ad0-4ef1-8195-8ebe7f993c65 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:38.473832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-217fa54d-5ad0-4ef1-8195-8ebe7f993c65 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:38.609747 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-217fa54d-5ad0-4ef1-8195-8ebe7f993c65 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:38.617759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-217fa54d-5ad0-4ef1-8195-8ebe7f993c65 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1357 microversion: 2.1 time: 0.156560 Jun 15 10:19:38.618811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 416/847] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:38 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:38.726450 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:38.727150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:38.733553 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:38.733959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:38.734765 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:38.735208 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:38.875234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:38.883793 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:38.885299 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:38.886499 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-247f41ca-39f6-4899-8784-8e042dbf5015 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1807 microversion: 2.20 time: 0.164605 Jun 15 10:19:38.887129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 432/848] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:38 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:19:39.398627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-197dd1f3-1a99-44d3-ba0a-e73ceabca459 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:39.399242 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-197dd1f3-1a99-44d3-ba0a-e73ceabca459 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:39.407081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-197dd1f3-1a99-44d3-ba0a-e73ceabca459 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.407766 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-197dd1f3-1a99-44d3-ba0a-e73ceabca459 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.408715 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-197dd1f3-1a99-44d3-ba0a-e73ceabca459 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.409206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-197dd1f3-1a99-44d3-ba0a-e73ceabca459 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.546698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-197dd1f3-1a99-44d3-ba0a-e73ceabca459 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:39.554637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-197dd1f3-1a99-44d3-ba0a-e73ceabca459 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.159803 Jun 15 10:19:39.555206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 417/849] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:39 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:39.634797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-945341ff-73a9-4fff-96ae-271295ac41f8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:39.635416 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-945341ff-73a9-4fff-96ae-271295ac41f8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:39.641965 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-945341ff-73a9-4fff-96ae-271295ac41f8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.642457 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-945341ff-73a9-4fff-96ae-271295ac41f8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.643228 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-945341ff-73a9-4fff-96ae-271295ac41f8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.643670 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-945341ff-73a9-4fff-96ae-271295ac41f8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.771243 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-945341ff-73a9-4fff-96ae-271295ac41f8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:39.778561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-945341ff-73a9-4fff-96ae-271295ac41f8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1547 microversion: 2.1 time: 0.147506 Jun 15 10:19:39.779180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 433/850] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:39 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:39.795234 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b6ecfc94-23fc-48a7-b1fb-3e47343f252f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:39.796003 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b6ecfc94-23fc-48a7-b1fb-3e47343f252f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:39.802628 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6ecfc94-23fc-48a7-b1fb-3e47343f252f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.803079 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6ecfc94-23fc-48a7-b1fb-3e47343f252f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.803838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6ecfc94-23fc-48a7-b1fb-3e47343f252f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.804279 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b6ecfc94-23fc-48a7-b1fb-3e47343f252f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.908246 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:39.908893 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:39.914830 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.915284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.916051 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.916490 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.931887 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b6ecfc94-23fc-48a7-b1fb-3e47343f252f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:39.939475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b6ecfc94-23fc-48a7-b1fb-3e47343f252f tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1547 microversion: 2.1 time: 0.148066 Jun 15 10:19:39.940044 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 418/851] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:39 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:39.955785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:39.959247 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:39.960015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Searching by: {'deleted': False, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f'} {{(pid=117721) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 10:19:39.966621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.967070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:39.969059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:39.969518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:40.051761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:40.060711 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:40.060899 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.multi_cell_list [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117721) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 10:19:40.063110 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:40.064374 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-efc9d1b2-6182-4e63-970e-e85e862b0aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1794 microversion: 2.20 time: 0.161355 Jun 15 10:19:40.064937 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 434/852] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:19:39 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1794 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:19:40.163620 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6f278e04-92b7-4485-b2b9-5ce24c5e5555 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212522 Jun 15 10:19:40.164683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 419/853] 10.222.0.57 () {58 vars in 1124 bytes} [Wed Jun 15 10:19:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:19:40.176129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e4807d93-0599-4815-8f74-0341ba2a0ece tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:40.176947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e4807d93-0599-4815-8f74-0341ba2a0ece tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:40.182980 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4807d93-0599-4815-8f74-0341ba2a0ece tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:40.183399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4807d93-0599-4815-8f74-0341ba2a0ece tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:40.184170 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4807d93-0599-4815-8f74-0341ba2a0ece tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:40.184606 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4807d93-0599-4815-8f74-0341ba2a0ece tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:40.325925 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e4807d93-0599-4815-8f74-0341ba2a0ece tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:40.334404 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e4807d93-0599-4815-8f74-0341ba2a0ece tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1547 microversion: 2.1 time: 0.163676 Jun 15 10:19:40.335522 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 435/854] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:40 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:40.572023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0f52a007-b028-4547-90d4-1a039f795c79 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:40.572892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0f52a007-b028-4547-90d4-1a039f795c79 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:40.580410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f52a007-b028-4547-90d4-1a039f795c79 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:40.580938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f52a007-b028-4547-90d4-1a039f795c79 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:40.581714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f52a007-b028-4547-90d4-1a039f795c79 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:40.582353 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0f52a007-b028-4547-90d4-1a039f795c79 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:40.732437 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0f52a007-b028-4547-90d4-1a039f795c79 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:40.741256 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0f52a007-b028-4547-90d4-1a039f795c79 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.174160 Jun 15 10:19:40.741855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 420/855] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:40 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:41.762016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-69e1795a-9133-44c7-a447-5fd03cf6726c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:41.762963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-69e1795a-9133-44c7-a447-5fd03cf6726c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:41.772093 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69e1795a-9133-44c7-a447-5fd03cf6726c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:41.772653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69e1795a-9133-44c7-a447-5fd03cf6726c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:41.773528 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69e1795a-9133-44c7-a447-5fd03cf6726c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:41.775017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69e1795a-9133-44c7-a447-5fd03cf6726c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:41.943122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-69e1795a-9133-44c7-a447-5fd03cf6726c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:41.955525 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-69e1795a-9133-44c7-a447-5fd03cf6726c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.198173 Jun 15 10:19:41.956452 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 436/856] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:41 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:42.937987 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d463a091-dee5-471a-bf87-221f3d2ecf55 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ac788de-ef9b-4ca6-9c33-e34eae8a7599"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:42.939094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d463a091-dee5-471a-bf87-221f3d2ecf55 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:42.945526 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d463a091-dee5-471a-bf87-221f3d2ecf55 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:42.945977 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d463a091-dee5-471a-bf87-221f3d2ecf55 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:42.946783 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d463a091-dee5-471a-bf87-221f3d2ecf55 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:42.947222 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d463a091-dee5-471a-bf87-221f3d2ecf55 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:42.974191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-098ae42b-985d-430b-8a47-27b48a03da8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:42.975364 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-098ae42b-985d-430b-8a47-27b48a03da8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:42.983992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-098ae42b-985d-430b-8a47-27b48a03da8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:42.984454 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-098ae42b-985d-430b-8a47-27b48a03da8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:42.985266 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-098ae42b-985d-430b-8a47-27b48a03da8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:42.985713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-098ae42b-985d-430b-8a47-27b48a03da8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:43.215771 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-098ae42b-985d-430b-8a47-27b48a03da8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:43.224722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-098ae42b-985d-430b-8a47-27b48a03da8a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.254314 Jun 15 10:19:43.225748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 437/857] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:42 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:43.264183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d463a091-dee5-471a-bf87-221f3d2ecf55 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "POST /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330085 Jun 15 10:19:43.264883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 421/858] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:19:42 2022] POST /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:44.242892 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fec0e027-d857-4adf-a967-f4ec32351f66 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:44.243547 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fec0e027-d857-4adf-a967-f4ec32351f66 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:44.245856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=86 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:44.251850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fec0e027-d857-4adf-a967-f4ec32351f66 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:44.252332 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fec0e027-d857-4adf-a967-f4ec32351f66 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:44.253099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fec0e027-d857-4adf-a967-f4ec32351f66 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:44.253566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fec0e027-d857-4adf-a967-f4ec32351f66 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:44.386599 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fec0e027-d857-4adf-a967-f4ec32351f66 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:44.395584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fec0e027-d857-4adf-a967-f4ec32351f66 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.156567 Jun 15 10:19:44.396178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 438/859] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:44 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:45.415537 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e109e7da-653f-4960-a70e-96cbbc50c3c4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:45.416183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e109e7da-653f-4960-a70e-96cbbc50c3c4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:45.423280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e109e7da-653f-4960-a70e-96cbbc50c3c4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:45.423731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e109e7da-653f-4960-a70e-96cbbc50c3c4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:45.424495 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e109e7da-653f-4960-a70e-96cbbc50c3c4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:45.424934 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e109e7da-653f-4960-a70e-96cbbc50c3c4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:45.553793 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e109e7da-653f-4960-a70e-96cbbc50c3c4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:45.562291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e109e7da-653f-4960-a70e-96cbbc50c3c4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.151760 Jun 15 10:19:45.562897 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 422/860] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:45 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:46.580501 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-263b4a35-de43-47d5-b85b-5e2c23ac59ff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:46.581313 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-263b4a35-de43-47d5-b85b-5e2c23ac59ff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:46.588445 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-263b4a35-de43-47d5-b85b-5e2c23ac59ff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:46.588924 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-263b4a35-de43-47d5-b85b-5e2c23ac59ff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:46.589732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-263b4a35-de43-47d5-b85b-5e2c23ac59ff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:46.590188 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-263b4a35-de43-47d5-b85b-5e2c23ac59ff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:46.723182 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-263b4a35-de43-47d5-b85b-5e2c23ac59ff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:46.731479 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-263b4a35-de43-47d5-b85b-5e2c23ac59ff tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.156073 Jun 15 10:19:46.732237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 439/861] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:46 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:47.018535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:19:47.018737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Wed Jun 15 10:19:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:19:47.750597 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-44034daa-0177-44ef-9b11-76e1f565e30c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:47.751215 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-44034daa-0177-44ef-9b11-76e1f565e30c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:47.757632 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44034daa-0177-44ef-9b11-76e1f565e30c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:47.758085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44034daa-0177-44ef-9b11-76e1f565e30c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:47.758888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44034daa-0177-44ef-9b11-76e1f565e30c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:47.759328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44034daa-0177-44ef-9b11-76e1f565e30c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:47.895838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-44034daa-0177-44ef-9b11-76e1f565e30c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:47.903817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-44034daa-0177-44ef-9b11-76e1f565e30c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.157212 Jun 15 10:19:47.904387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 423/862] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:47 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:48.920594 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-87a26c86-51ce-4d14-82c9-d11f31979fa8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:48.921225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-87a26c86-51ce-4d14-82c9-d11f31979fa8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:48.930902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87a26c86-51ce-4d14-82c9-d11f31979fa8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:48.931371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87a26c86-51ce-4d14-82c9-d11f31979fa8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:48.932189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87a26c86-51ce-4d14-82c9-d11f31979fa8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:48.932643 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87a26c86-51ce-4d14-82c9-d11f31979fa8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:49.070980 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-87a26c86-51ce-4d14-82c9-d11f31979fa8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:49.080017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-87a26c86-51ce-4d14-82c9-d11f31979fa8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.163287 Jun 15 10:19:49.080576 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 440/863] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:48 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:50.097379 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e1a3ad3b-8fc9-48ac-bc91-49b438a50353 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:50.097993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e1a3ad3b-8fc9-48ac-bc91-49b438a50353 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:50.101742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:50.111173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e1a3ad3b-8fc9-48ac-bc91-49b438a50353 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:50.111800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e1a3ad3b-8fc9-48ac-bc91-49b438a50353 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:50.112706 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e1a3ad3b-8fc9-48ac-bc91-49b438a50353 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:50.113399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e1a3ad3b-8fc9-48ac-bc91-49b438a50353 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:50.119777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:50.262743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e1a3ad3b-8fc9-48ac-bc91-49b438a50353 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:50.271348 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e1a3ad3b-8fc9-48ac-bc91-49b438a50353 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.177785 Jun 15 10:19:50.271914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 424/864] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:50 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:51.288866 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7261fdde-09c0-4aef-a5af-eda49db849eb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:51.289542 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7261fdde-09c0-4aef-a5af-eda49db849eb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:51.297040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7261fdde-09c0-4aef-a5af-eda49db849eb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:51.297509 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7261fdde-09c0-4aef-a5af-eda49db849eb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:51.298319 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7261fdde-09c0-4aef-a5af-eda49db849eb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:51.298754 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7261fdde-09c0-4aef-a5af-eda49db849eb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:51.433693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7261fdde-09c0-4aef-a5af-eda49db849eb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:51.442114 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7261fdde-09c0-4aef-a5af-eda49db849eb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.157070 Jun 15 10:19:51.443045 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 441/865] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:51 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:51.691326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1ee827fe-b8d3-4ce3-bbf5-40db0a42ae0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50d9f8e0-4615-4d4f-8f6c-ad3877b64b12"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:51.692527 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1ee827fe-b8d3-4ce3-bbf5-40db0a42ae0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:51.698533 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1ee827fe-b8d3-4ce3-bbf5-40db0a42ae0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:51.698981 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1ee827fe-b8d3-4ce3-bbf5-40db0a42ae0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:51.699738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1ee827fe-b8d3-4ce3-bbf5-40db0a42ae0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:51.700173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1ee827fe-b8d3-4ce3-bbf5-40db0a42ae0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:51.892931 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-95a1bedd-cbe0-4ebc-bbbf-eac5ce55ebac tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:51.893609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-95a1bedd-cbe0-4ebc-bbbf-eac5ce55ebac tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:51.899550 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95a1bedd-cbe0-4ebc-bbbf-eac5ce55ebac tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:51.900012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95a1bedd-cbe0-4ebc-bbbf-eac5ce55ebac tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:51.900776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95a1bedd-cbe0-4ebc-bbbf-eac5ce55ebac tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:51.901220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-95a1bedd-cbe0-4ebc-bbbf-eac5ce55ebac tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:52.035706 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-95a1bedd-cbe0-4ebc-bbbf-eac5ce55ebac tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:52.043859 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-95a1bedd-cbe0-4ebc-bbbf-eac5ce55ebac tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1593 microversion: 2.1 time: 0.155225 Jun 15 10:19:52.044414 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 442/866] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:51 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:52.149079 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1ee827fe-b8d3-4ce3-bbf5-40db0a42ae0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631993 Jun 15 10:19:52.149853 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 425/867] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:19:51 2022] POST /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:52.460221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-afe43393-f8db-41e0-9523-0f3af48bd1c3 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:52.460840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-afe43393-f8db-41e0-9523-0f3af48bd1c3 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:52.468635 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-afe43393-f8db-41e0-9523-0f3af48bd1c3 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:52.469100 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-afe43393-f8db-41e0-9523-0f3af48bd1c3 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:52.469883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-afe43393-f8db-41e0-9523-0f3af48bd1c3 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:52.470351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-afe43393-f8db-41e0-9523-0f3af48bd1c3 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:52.606054 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-afe43393-f8db-41e0-9523-0f3af48bd1c3 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:52.617134 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-afe43393-f8db-41e0-9523-0f3af48bd1c3 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.160740 Jun 15 10:19:52.617834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 443/868] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:52 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:53.635375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1409f963-eb20-4d31-b363-b7e02b7666dd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:53.636083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1409f963-eb20-4d31-b363-b7e02b7666dd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:53.643277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1409f963-eb20-4d31-b363-b7e02b7666dd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:53.643733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1409f963-eb20-4d31-b363-b7e02b7666dd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:53.644505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1409f963-eb20-4d31-b363-b7e02b7666dd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:53.644943 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1409f963-eb20-4d31-b363-b7e02b7666dd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:53.789352 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-7a5ce823-cf6d-4c2f-aa8b-f21a0a5f892c req-66b54ebb-3a7d-4b60-8f34-c27b3318a4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f24d77-e20b-448e-aa55-b4aa206c4abf", "tag": "7ed10135-626d-4a21-82fb-bafe20ebc074"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:53.799053 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-7a5ce823-cf6d-4c2f-aa8b-f21a0a5f892c req-66b54ebb-3a7d-4b60-8f34-c27b3318a4b7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:53.799502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-7a5ce823-cf6d-4c2f-aa8b-f21a0a5f892c req-66b54ebb-3a7d-4b60-8f34-c27b3318a4b7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:53.811391 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-7a5ce823-cf6d-4c2f-aa8b-f21a0a5f892c req-66b54ebb-3a7d-4b60-8f34-c27b3318a4b7 service nova] Creating event network-changed:7ed10135-626d-4a21-82fb-bafe20ebc074 for instance 84f24d77-e20b-448e-aa55-b4aa206c4abf on hv-cinder-83028 Jun 15 10:19:53.812410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1409f963-eb20-4d31-b363-b7e02b7666dd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:53.816753 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-7a5ce823-cf6d-4c2f-aa8b-f21a0a5f892c req-66b54ebb-3a7d-4b60-8f34-c27b3318a4b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030987 Jun 15 10:19:53.820267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 444/869] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:19:53.823480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1409f963-eb20-4d31-b363-b7e02b7666dd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.192099 Jun 15 10:19:53.824151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 426/870] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:53 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:54.724503 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4a9e9056-565e-4ced-adb1-a085eef33aad tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1335939552"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:54.725149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4a9e9056-565e-4ced-adb1-a085eef33aad tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:54.731665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a9e9056-565e-4ced-adb1-a085eef33aad tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:54.732109 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a9e9056-565e-4ced-adb1-a085eef33aad tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:54.733217 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a9e9056-565e-4ced-adb1-a085eef33aad tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:54.733620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4a9e9056-565e-4ced-adb1-a085eef33aad tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:54.840793 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1fb3b700-a649-4db3-a202-4b598481c902 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:54.841415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1fb3b700-a649-4db3-a202-4b598481c902 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:54.850098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1fb3b700-a649-4db3-a202-4b598481c902 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:54.851020 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1fb3b700-a649-4db3-a202-4b598481c902 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:54.851943 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1fb3b700-a649-4db3-a202-4b598481c902 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:54.852507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1fb3b700-a649-4db3-a202-4b598481c902 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:54.867717 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.network.security_group_api [None req-4a9e9056-565e-4ced-adb1-a085eef33aad tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Adding security group c02e9d36-1399-4652-bf94-6abd35835dc4 to port 7ed10135-626d-4a21-82fb-bafe20ebc074 Jun 15 10:19:55.063926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1fb3b700-a649-4db3-a202-4b598481c902 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:55.072037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1fb3b700-a649-4db3-a202-4b598481c902 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.235263 Jun 15 10:19:55.072599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 427/871] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:54 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:55.539925 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4a9e9056-565e-4ced-adb1-a085eef33aad tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "POST /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/action" status: 202 len: 0 microversion: 2.1 time: 0.819939 Jun 15 10:19:55.543862 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 445/872] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:19:54 2022] POST /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:19:55.549471 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-210ce1c6-e7ac-4173-bd1d-d5df1bcadb61 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:55.550202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-210ce1c6-e7ac-4173-bd1d-d5df1bcadb61 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:55.550744 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f966e6d1-3629-416e-9d1f-d5725d7557e9 req-ea8668ec-ec53-484d-9382-63bdaaee3b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f24d77-e20b-448e-aa55-b4aa206c4abf", "tag": "7ed10135-626d-4a21-82fb-bafe20ebc074"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:55.559079 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f966e6d1-3629-416e-9d1f-d5725d7557e9 req-ea8668ec-ec53-484d-9382-63bdaaee3b5a service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:55.559570 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f966e6d1-3629-416e-9d1f-d5725d7557e9 req-ea8668ec-ec53-484d-9382-63bdaaee3b5a service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:55.565350 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-210ce1c6-e7ac-4173-bd1d-d5df1bcadb61 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:55.565913 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-210ce1c6-e7ac-4173-bd1d-d5df1bcadb61 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:55.566834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-210ce1c6-e7ac-4173-bd1d-d5df1bcadb61 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:55.567387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-210ce1c6-e7ac-4173-bd1d-d5df1bcadb61 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:55.586237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f966e6d1-3629-416e-9d1f-d5725d7557e9 req-ea8668ec-ec53-484d-9382-63bdaaee3b5a service nova] Creating event network-changed:7ed10135-626d-4a21-82fb-bafe20ebc074 for instance 84f24d77-e20b-448e-aa55-b4aa206c4abf on hv-cinder-83028 Jun 15 10:19:55.598871 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f966e6d1-3629-416e-9d1f-d5725d7557e9 req-ea8668ec-ec53-484d-9382-63bdaaee3b5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051848 Jun 15 10:19:55.600081 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 446/873] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:55.724500 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-210ce1c6-e7ac-4173-bd1d-d5df1bcadb61 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:55.732995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-210ce1c6-e7ac-4173-bd1d-d5df1bcadb61 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1640 microversion: 2.1 time: 0.186838 Jun 15 10:19:55.733555 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 428/874] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:55 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1640 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:56.090111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4dc76a63-5649-4cd1-b0fe-20d96e7d0a4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:56.090848 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4dc76a63-5649-4cd1-b0fe-20d96e7d0a4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:56.097995 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4dc76a63-5649-4cd1-b0fe-20d96e7d0a4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:56.098488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4dc76a63-5649-4cd1-b0fe-20d96e7d0a4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:56.099510 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4dc76a63-5649-4cd1-b0fe-20d96e7d0a4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:56.099949 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4dc76a63-5649-4cd1-b0fe-20d96e7d0a4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:56.231076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4dc76a63-5649-4cd1-b0fe-20d96e7d0a4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:56.239383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4dc76a63-5649-4cd1-b0fe-20d96e7d0a4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1722 microversion: 2.1 time: 0.153440 Jun 15 10:19:56.239940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 447/875] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:56 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:57.256878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4dd118bf-6145-4ee6-8ab9-f34dcba256f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:57.257638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4dd118bf-6145-4ee6-8ab9-f34dcba256f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:57.264779 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4dd118bf-6145-4ee6-8ab9-f34dcba256f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:57.265223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4dd118bf-6145-4ee6-8ab9-f34dcba256f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:57.265992 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4dd118bf-6145-4ee6-8ab9-f34dcba256f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:57.266456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4dd118bf-6145-4ee6-8ab9-f34dcba256f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:57.510894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4dd118bf-6145-4ee6-8ab9-f34dcba256f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:57.520508 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4dd118bf-6145-4ee6-8ab9-f34dcba256f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1699 microversion: 2.1 time: 0.267415 Jun 15 10:19:57.521336 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 429/876] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:57 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1699 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:19:57.538129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1e27b787-a27e-4f79-ae41-adf85b3db0da tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:57.545497 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1e27b787-a27e-4f79-ae41-adf85b3db0da tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:57.546457 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1e27b787-a27e-4f79-ae41-adf85b3db0da tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:57.570911 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1e27b787-a27e-4f79-ae41-adf85b3db0da tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Going to try to start instance {{(pid=117720) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 10:19:57.596367 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:57.618763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1e27b787-a27e-4f79-ae41-adf85b3db0da tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/action" status: 202 len: 0 microversion: 2.1 time: 0.084205 Jun 15 10:19:57.622312 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 448/877] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:19:57 2022] POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:19:57.629375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-94132618-1efd-42f2-bf16-9b17edaad425 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:57.630301 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-94132618-1efd-42f2-bf16-9b17edaad425 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:57.637691 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94132618-1efd-42f2-bf16-9b17edaad425 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:57.642485 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94132618-1efd-42f2-bf16-9b17edaad425 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:57.643532 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94132618-1efd-42f2-bf16-9b17edaad425 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:57.644325 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94132618-1efd-42f2-bf16-9b17edaad425 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:57.885584 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-94132618-1efd-42f2-bf16-9b17edaad425 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:57.896715 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-94132618-1efd-42f2-bf16-9b17edaad425 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1708 microversion: 2.1 time: 0.272479 Jun 15 10:19:57.897301 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 430/878] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:57 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1708 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:58.915297 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a863eeea-5173-49c4-b228-df49e8701dcd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:58.915995 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a863eeea-5173-49c4-b228-df49e8701dcd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:58.923507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a863eeea-5173-49c4-b228-df49e8701dcd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:58.923958 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a863eeea-5173-49c4-b228-df49e8701dcd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:58.924726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a863eeea-5173-49c4-b228-df49e8701dcd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:58.925196 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a863eeea-5173-49c4-b228-df49e8701dcd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:59.082218 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a863eeea-5173-49c4-b228-df49e8701dcd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:19:59.090770 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a863eeea-5173-49c4-b228-df49e8701dcd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1708 microversion: 2.1 time: 0.180079 Jun 15 10:19:59.091854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 449/879] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:58 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:59.680038 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-16dd9563-70ad-4af8-bfef-a69854fa0181 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:19:59.681056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-16dd9563-70ad-4af8-bfef-a69854fa0181 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:59.690798 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16dd9563-70ad-4af8-bfef-a69854fa0181 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:59.691257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16dd9563-70ad-4af8-bfef-a69854fa0181 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:59.692038 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16dd9563-70ad-4af8-bfef-a69854fa0181 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:59.692480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16dd9563-70ad-4af8-bfef-a69854fa0181 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:59.719140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-16dd9563-70ad-4af8-bfef-a69854fa0181 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lazy-loading 'flavor' on Instance uuid 297abce4-955d-4411-8d84-3b14a31c5f19 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:19:59.842559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-16dd9563-70ad-4af8-bfef-a69854fa0181 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/action" status: 200 len: 32 microversion: 2.1 time: 0.166411 Jun 15 10:19:59.843160 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 431/880] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:19:59 2022] POST /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:19:59.852404 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3ed7427c-5fb9-4f9c-8296-a7b5e28966ac tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:59.853028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3ed7427c-5fb9-4f9c-8296-a7b5e28966ac tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:19:59.860491 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ed7427c-5fb9-4f9c-8296-a7b5e28966ac tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:59.861669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ed7427c-5fb9-4f9c-8296-a7b5e28966ac tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:59.862484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ed7427c-5fb9-4f9c-8296-a7b5e28966ac tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:59.862940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3ed7427c-5fb9-4f9c-8296-a7b5e28966ac tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:59.998249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3ed7427c-5fb9-4f9c-8296-a7b5e28966ac tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:00.006513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3ed7427c-5fb9-4f9c-8296-a7b5e28966ac tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.158192 Jun 15 10:20:00.007082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 450/881] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:19:59 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:00.109682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c71394bc-2a35-4eb3-a316-d5f5ef372a02 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:00.110773 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c71394bc-2a35-4eb3-a316-d5f5ef372a02 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:00.117258 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c71394bc-2a35-4eb3-a316-d5f5ef372a02 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:00.117740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c71394bc-2a35-4eb3-a316-d5f5ef372a02 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:00.118589 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c71394bc-2a35-4eb3-a316-d5f5ef372a02 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:00.119050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c71394bc-2a35-4eb3-a316-d5f5ef372a02 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:00.250883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c71394bc-2a35-4eb3-a316-d5f5ef372a02 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:00.258780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c71394bc-2a35-4eb3-a316-d5f5ef372a02 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1708 microversion: 2.1 time: 0.153624 Jun 15 10:20:00.259350 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 432/882] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:00 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:01.025024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6018abdf-6717-4d7b-964b-27fd7bb38a0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:01.025557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6018abdf-6717-4d7b-964b-27fd7bb38a0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:01.032693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6018abdf-6717-4d7b-964b-27fd7bb38a0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:01.033157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6018abdf-6717-4d7b-964b-27fd7bb38a0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:01.033930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6018abdf-6717-4d7b-964b-27fd7bb38a0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:01.034406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6018abdf-6717-4d7b-964b-27fd7bb38a0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:01.213143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6018abdf-6717-4d7b-964b-27fd7bb38a0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:01.223551 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6018abdf-6717-4d7b-964b-27fd7bb38a0f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.202437 Jun 15 10:20:01.224766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 451/883] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:01 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:01.276741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-415af779-fb32-451b-8dc3-fcaeffecb69c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:01.277522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-415af779-fb32-451b-8dc3-fcaeffecb69c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:01.281000 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=54 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:01.287190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-415af779-fb32-451b-8dc3-fcaeffecb69c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:01.287759 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-415af779-fb32-451b-8dc3-fcaeffecb69c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:01.288562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-415af779-fb32-451b-8dc3-fcaeffecb69c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:01.289002 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-415af779-fb32-451b-8dc3-fcaeffecb69c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:01.429962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-415af779-fb32-451b-8dc3-fcaeffecb69c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:01.438613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-415af779-fb32-451b-8dc3-fcaeffecb69c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1712 microversion: 2.1 time: 0.165988 Jun 15 10:20:01.439179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 433/884] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:01 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1712 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:02.242520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-146facf2-db9a-401f-bb88-021f50ad068b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:02.243138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-146facf2-db9a-401f-bb88-021f50ad068b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:02.249704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-146facf2-db9a-401f-bb88-021f50ad068b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:02.250167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-146facf2-db9a-401f-bb88-021f50ad068b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:02.250987 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-146facf2-db9a-401f-bb88-021f50ad068b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:02.251434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-146facf2-db9a-401f-bb88-021f50ad068b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:02.388674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-146facf2-db9a-401f-bb88-021f50ad068b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:02.397033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-146facf2-db9a-401f-bb88-021f50ad068b tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.158426 Jun 15 10:20:02.397587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 452/885] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:02 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:03.414234 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f6a7f853-8f1c-4f18-bc85-33046ce21f93 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:03.414859 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f6a7f853-8f1c-4f18-bc85-33046ce21f93 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:03.422124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6a7f853-8f1c-4f18-bc85-33046ce21f93 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:03.422590 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6a7f853-8f1c-4f18-bc85-33046ce21f93 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:03.423352 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6a7f853-8f1c-4f18-bc85-33046ce21f93 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:03.423784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6a7f853-8f1c-4f18-bc85-33046ce21f93 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:03.551199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f6a7f853-8f1c-4f18-bc85-33046ce21f93 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:03.559055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f6a7f853-8f1c-4f18-bc85-33046ce21f93 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.148679 Jun 15 10:20:03.559617 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 434/886] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:03 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:04.576188 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ca9749c8-99a9-458f-a67c-18e1ebaa1dc9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:04.577160 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ca9749c8-99a9-458f-a67c-18e1ebaa1dc9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:04.583660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ca9749c8-99a9-458f-a67c-18e1ebaa1dc9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:04.584107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ca9749c8-99a9-458f-a67c-18e1ebaa1dc9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:04.584858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ca9749c8-99a9-458f-a67c-18e1ebaa1dc9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:04.585290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ca9749c8-99a9-458f-a67c-18e1ebaa1dc9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:04.710912 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ca9749c8-99a9-458f-a67c-18e1ebaa1dc9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:04.718743 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ca9749c8-99a9-458f-a67c-18e1ebaa1dc9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.146422 Jun 15 10:20:04.719303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 453/887] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:04 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:05.736130 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d1163e70-669a-4382-85d2-b903920c182e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:05.736767 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d1163e70-669a-4382-85d2-b903920c182e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:05.743184 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d1163e70-669a-4382-85d2-b903920c182e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:05.743637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d1163e70-669a-4382-85d2-b903920c182e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:05.744390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d1163e70-669a-4382-85d2-b903920c182e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:05.744820 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d1163e70-669a-4382-85d2-b903920c182e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:05.881199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d1163e70-669a-4382-85d2-b903920c182e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:05.889900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d1163e70-669a-4382-85d2-b903920c182e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.157182 Jun 15 10:20:05.890530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 435/888] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:05 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:06.907614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-87a29cfc-af82-4bae-840a-4668c7781ea3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:06.908224 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-87a29cfc-af82-4bae-840a-4668c7781ea3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:06.914702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87a29cfc-af82-4bae-840a-4668c7781ea3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:06.915153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87a29cfc-af82-4bae-840a-4668c7781ea3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:06.915910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87a29cfc-af82-4bae-840a-4668c7781ea3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:06.916349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-87a29cfc-af82-4bae-840a-4668c7781ea3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:07.049613 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-87a29cfc-af82-4bae-840a-4668c7781ea3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:07.057949 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-87a29cfc-af82-4bae-840a-4668c7781ea3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.154681 Jun 15 10:20:07.058539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 454/889] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:06 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:08.075282 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1efade2c-7a80-44d4-bb75-59b677dbb8a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:08.075899 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1efade2c-7a80-44d4-bb75-59b677dbb8a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:08.082569 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1efade2c-7a80-44d4-bb75-59b677dbb8a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:08.083083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1efade2c-7a80-44d4-bb75-59b677dbb8a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:08.083854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1efade2c-7a80-44d4-bb75-59b677dbb8a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:08.084295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1efade2c-7a80-44d4-bb75-59b677dbb8a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:08.217419 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1efade2c-7a80-44d4-bb75-59b677dbb8a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:08.226226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1efade2c-7a80-44d4-bb75-59b677dbb8a5 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.154837 Jun 15 10:20:08.226824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 436/890] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:08 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:09.243201 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e8a8b0c8-96c2-4f70-a7aa-b580a02348e2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:09.243850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e8a8b0c8-96c2-4f70-a7aa-b580a02348e2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:09.250828 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8a8b0c8-96c2-4f70-a7aa-b580a02348e2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:09.251288 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8a8b0c8-96c2-4f70-a7aa-b580a02348e2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:09.252050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8a8b0c8-96c2-4f70-a7aa-b580a02348e2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:09.252489 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8a8b0c8-96c2-4f70-a7aa-b580a02348e2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:09.380457 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e8a8b0c8-96c2-4f70-a7aa-b580a02348e2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:09.388206 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e8a8b0c8-96c2-4f70-a7aa-b580a02348e2 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.148860 Jun 15 10:20:09.388773 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 455/891] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:09 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:10.404945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c26ee994-ee5d-47b4-8022-3c1622043634 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:10.405563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c26ee994-ee5d-47b4-8022-3c1622043634 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:10.412938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c26ee994-ee5d-47b4-8022-3c1622043634 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:10.413384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c26ee994-ee5d-47b4-8022-3c1622043634 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:10.414141 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c26ee994-ee5d-47b4-8022-3c1622043634 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:10.414604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c26ee994-ee5d-47b4-8022-3c1622043634 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:10.428966 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:10.549563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c26ee994-ee5d-47b4-8022-3c1622043634 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:10.557604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c26ee994-ee5d-47b4-8022-3c1622043634 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.156534 Jun 15 10:20:10.558172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 437/892] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:10 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:11.574185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5851a9ac-6f3b-45d8-9b7e-aac45226bca3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:11.574734 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5851a9ac-6f3b-45d8-9b7e-aac45226bca3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:11.581556 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5851a9ac-6f3b-45d8-9b7e-aac45226bca3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:11.582000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5851a9ac-6f3b-45d8-9b7e-aac45226bca3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:11.582778 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5851a9ac-6f3b-45d8-9b7e-aac45226bca3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:11.583213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5851a9ac-6f3b-45d8-9b7e-aac45226bca3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:11.714432 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5851a9ac-6f3b-45d8-9b7e-aac45226bca3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:11.722724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5851a9ac-6f3b-45d8-9b7e-aac45226bca3 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.152425 Jun 15 10:20:11.723531 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 456/893] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:11 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:12.740907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a645ba62-b299-4284-8346-8dbca8b46d6a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:12.741552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a645ba62-b299-4284-8346-8dbca8b46d6a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:12.748037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a645ba62-b299-4284-8346-8dbca8b46d6a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:12.748494 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a645ba62-b299-4284-8346-8dbca8b46d6a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:12.749268 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a645ba62-b299-4284-8346-8dbca8b46d6a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:12.750473 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a645ba62-b299-4284-8346-8dbca8b46d6a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:12.889242 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a645ba62-b299-4284-8346-8dbca8b46d6a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:12.898557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a645ba62-b299-4284-8346-8dbca8b46d6a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.161533 Jun 15 10:20:12.899127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 438/894] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:12 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:13.916016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-93545e92-60dc-48b0-af02-b2b3b0386766 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:13.916627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-93545e92-60dc-48b0-af02-b2b3b0386766 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:13.923701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93545e92-60dc-48b0-af02-b2b3b0386766 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:13.924152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93545e92-60dc-48b0-af02-b2b3b0386766 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:13.924908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93545e92-60dc-48b0-af02-b2b3b0386766 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:13.925345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93545e92-60dc-48b0-af02-b2b3b0386766 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:14.055756 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-93545e92-60dc-48b0-af02-b2b3b0386766 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:14.064746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-93545e92-60dc-48b0-af02-b2b3b0386766 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.152596 Jun 15 10:20:14.065307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 457/895] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:13 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:15.082177 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c3afb622-ecae-45bd-9cb6-e027a0c79fa7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:15.082826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c3afb622-ecae-45bd-9cb6-e027a0c79fa7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:15.089309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3afb622-ecae-45bd-9cb6-e027a0c79fa7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:15.089758 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3afb622-ecae-45bd-9cb6-e027a0c79fa7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:15.090557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3afb622-ecae-45bd-9cb6-e027a0c79fa7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:15.090997 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c3afb622-ecae-45bd-9cb6-e027a0c79fa7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:15.220176 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c3afb622-ecae-45bd-9cb6-e027a0c79fa7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:15.228295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c3afb622-ecae-45bd-9cb6-e027a0c79fa7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.150479 Jun 15 10:20:15.228854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 439/896] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:15 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:16.246647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b3ab3aa6-8459-414f-8971-d178f793a187 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:16.247260 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b3ab3aa6-8459-414f-8971-d178f793a187 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:16.249799 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=40 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:16.255267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3ab3aa6-8459-414f-8971-d178f793a187 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:16.255725 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3ab3aa6-8459-414f-8971-d178f793a187 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:16.256498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3ab3aa6-8459-414f-8971-d178f793a187 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:16.256946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3ab3aa6-8459-414f-8971-d178f793a187 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:16.386543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b3ab3aa6-8459-414f-8971-d178f793a187 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:16.395153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b3ab3aa6-8459-414f-8971-d178f793a187 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.152407 Jun 15 10:20:16.395720 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 458/897] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:16 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:17.418089 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2fe1b766-5717-4d90-8d3d-071002452ccd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:17.418686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2fe1b766-5717-4d90-8d3d-071002452ccd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:17.425586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fe1b766-5717-4d90-8d3d-071002452ccd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:17.426030 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fe1b766-5717-4d90-8d3d-071002452ccd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:17.426822 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fe1b766-5717-4d90-8d3d-071002452ccd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:17.427255 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2fe1b766-5717-4d90-8d3d-071002452ccd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:17.555585 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2fe1b766-5717-4d90-8d3d-071002452ccd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:17.563938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2fe1b766-5717-4d90-8d3d-071002452ccd tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.150010 Jun 15 10:20:17.564498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 440/898] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:17 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:18.580969 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-45f4b235-4cc9-4f0f-a112-9442e083c079 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:18.581576 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-45f4b235-4cc9-4f0f-a112-9442e083c079 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:18.588074 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-45f4b235-4cc9-4f0f-a112-9442e083c079 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:18.588519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-45f4b235-4cc9-4f0f-a112-9442e083c079 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:18.589270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-45f4b235-4cc9-4f0f-a112-9442e083c079 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:18.589702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-45f4b235-4cc9-4f0f-a112-9442e083c079 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:18.727004 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-45f4b235-4cc9-4f0f-a112-9442e083c079 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:18.735279 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-45f4b235-4cc9-4f0f-a112-9442e083c079 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.158220 Jun 15 10:20:18.735858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 459/899] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:18 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:19.752634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-aded539f-69aa-4a2a-962c-10a8f2a826a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:19.753251 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-aded539f-69aa-4a2a-962c-10a8f2a826a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:19.759728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aded539f-69aa-4a2a-962c-10a8f2a826a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:19.760176 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aded539f-69aa-4a2a-962c-10a8f2a826a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:19.760945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aded539f-69aa-4a2a-962c-10a8f2a826a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:19.761387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-aded539f-69aa-4a2a-962c-10a8f2a826a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:19.898080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-aded539f-69aa-4a2a-962c-10a8f2a826a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:19.906731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-aded539f-69aa-4a2a-962c-10a8f2a826a6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1737 microversion: 2.1 time: 0.157991 Jun 15 10:20:19.907303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 441/900] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:19 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:20.924426 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-03c5dcd4-8ead-482a-b40a-d11981d42f20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:20.925069 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-03c5dcd4-8ead-482a-b40a-d11981d42f20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:20.931330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-03c5dcd4-8ead-482a-b40a-d11981d42f20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:20.931784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-03c5dcd4-8ead-482a-b40a-d11981d42f20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:20.932552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-03c5dcd4-8ead-482a-b40a-d11981d42f20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:20.932992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-03c5dcd4-8ead-482a-b40a-d11981d42f20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:21.063810 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-03c5dcd4-8ead-482a-b40a-d11981d42f20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:21.072147 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-03c5dcd4-8ead-482a-b40a-d11981d42f20 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1717 microversion: 2.1 time: 0.152105 Jun 15 10:20:21.072711 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 460/901] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:20 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:21.178964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:21.179480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:21.185960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:21.186462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:21.187867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:21.188306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:21.267110 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] HTTP exception thrown: Cannot 'detach_volume' instance 297abce4-955d-4411-8d84-3b14a31c5f19 while it is in vm_state rescued Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Request method failure captured: Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments/50d9f8e0-4615-4d4f-8f6c-ad3877b64b12 HTTP/1.1 Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDPGezxxUQhZoaRjOmjrO4GX92zTzIAGqRYvqhrgqzKMZJIzwRhp-N5Kk83Zyn3ltxZRD6XjCZa2blxpkLuR7Y-Z5PlRaz8ttddyzvl6Xybpv8K1RH3cYLJ3CwaO5vx0IuHkZqaEM8vB3PMESABts-q1r3IwamZYcHJ0pbJcMdiMqI Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:20:21.268743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea38be6c5c604346974bc9acac9628cd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: a3ee143a68b64f6f84e569b2b1823c5c Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:20:21.270236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Cannot 'detach_volume' instance 297abce4-955d-4411-8d84-3b14a31c5f19 while it is in vm_state rescued Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'server_id': '297abce4-955d-4411-8d84-3b14a31c5f19', 'id': '50d9f8e0-4615-4d4f-8f6c-ad3877b64b12'} Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 297abce4-955d-4411-8d84-3b14a31c5f19 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:20:21.270964 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 297abce4-955d-4411-8d84-3b14a31c5f19 while it is in vm_state rescued Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 297abce4-955d-4411-8d84-3b14a31c5f19 while it is in vm_state rescued Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:21.272198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Returning 409 to user: Cannot 'detach_volume' instance 297abce4-955d-4411-8d84-3b14a31c5f19 while it is in vm_state rescued {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:20:21.273212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3ef8a7c0-2050-4c99-8f7b-7c7a27426f73 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "DELETE /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments/50d9f8e0-4615-4d4f-8f6c-ad3877b64b12" status: 409 len: 152 microversion: 2.1 time: 0.095194 Jun 15 10:20:21.273212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 442/902] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:20:21 2022] DELETE /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments/50d9f8e0-4615-4d4f-8f6c-ad3877b64b12 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 10:20:21.279191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-81c12db3-382d-4681-871a-86ce4d14b6de tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:20:21.279737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-81c12db3-382d-4681-871a-86ce4d14b6de tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:21.286376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81c12db3-382d-4681-871a-86ce4d14b6de tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:21.286832 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81c12db3-382d-4681-871a-86ce4d14b6de tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:21.287601 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81c12db3-382d-4681-871a-86ce4d14b6de tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:21.288043 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81c12db3-382d-4681-871a-86ce4d14b6de tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:21.354806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-81c12db3-382d-4681-871a-86ce4d14b6de tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "POST /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/action" status: 202 len: 0 microversion: 2.1 time: 0.079109 Jun 15 10:20:21.355371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 461/903] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:20:21 2022] POST /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:20:21.365361 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ea28b073-3e9e-45c8-b7a8-ebb05c62ae4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:21.365637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ea28b073-3e9e-45c8-b7a8-ebb05c62ae4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:21.372173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea28b073-3e9e-45c8-b7a8-ebb05c62ae4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:21.372695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea28b073-3e9e-45c8-b7a8-ebb05c62ae4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:21.373607 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea28b073-3e9e-45c8-b7a8-ebb05c62ae4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:21.374283 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea28b073-3e9e-45c8-b7a8-ebb05c62ae4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:21.514021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ea28b073-3e9e-45c8-b7a8-ebb05c62ae4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:21.522547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ea28b073-3e9e-45c8-b7a8-ebb05c62ae4d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1725 microversion: 2.1 time: 0.161530 Jun 15 10:20:21.523122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 443/904] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:21 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:22.541659 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b6c9470a-bff4-4d6a-8a55-916daf31e072 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:22.542409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b6c9470a-bff4-4d6a-8a55-916daf31e072 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:22.548564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b6c9470a-bff4-4d6a-8a55-916daf31e072 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:22.549021 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b6c9470a-bff4-4d6a-8a55-916daf31e072 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:22.549797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b6c9470a-bff4-4d6a-8a55-916daf31e072 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:22.550246 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b6c9470a-bff4-4d6a-8a55-916daf31e072 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:22.680851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b6c9470a-bff4-4d6a-8a55-916daf31e072 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:22.689024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b6c9470a-bff4-4d6a-8a55-916daf31e072 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1725 microversion: 2.1 time: 0.152111 Jun 15 10:20:22.689635 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 462/905] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:22 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:23.707257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-03c7d6b0-078a-413d-bc11-f7b2039b09a7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:23.707863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-03c7d6b0-078a-413d-bc11-f7b2039b09a7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:23.714334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03c7d6b0-078a-413d-bc11-f7b2039b09a7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:23.714779 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03c7d6b0-078a-413d-bc11-f7b2039b09a7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:23.715539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03c7d6b0-078a-413d-bc11-f7b2039b09a7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:23.715970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03c7d6b0-078a-413d-bc11-f7b2039b09a7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:23.847749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-03c7d6b0-078a-413d-bc11-f7b2039b09a7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:23.856687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-03c7d6b0-078a-413d-bc11-f7b2039b09a7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1725 microversion: 2.1 time: 0.152999 Jun 15 10:20:23.857440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 444/906] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:23 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:24.875158 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6df96226-1f17-435f-8035-5dd910e16812 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:24.875788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6df96226-1f17-435f-8035-5dd910e16812 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:24.882303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6df96226-1f17-435f-8035-5dd910e16812 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:24.882904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6df96226-1f17-435f-8035-5dd910e16812 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:24.883610 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6df96226-1f17-435f-8035-5dd910e16812 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:24.884066 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6df96226-1f17-435f-8035-5dd910e16812 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:25.168466 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6df96226-1f17-435f-8035-5dd910e16812 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:25.176933 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6df96226-1f17-435f-8035-5dd910e16812 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1731 microversion: 2.1 time: 0.305840 Jun 15 10:20:25.177495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 463/907] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:20:24 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1731 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:25.193557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-91d4a4be-a8fb-4536-992f-6a4c0c1610db tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:25.194065 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-91d4a4be-a8fb-4536-992f-6a4c0c1610db tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:25.200600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-91d4a4be-a8fb-4536-992f-6a4c0c1610db tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:25.201059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-91d4a4be-a8fb-4536-992f-6a4c0c1610db tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:25.201858 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-91d4a4be-a8fb-4536-992f-6a4c0c1610db tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:25.202565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-91d4a4be-a8fb-4536-992f-6a4c0c1610db tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:25.277544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-91d4a4be-a8fb-4536-992f-6a4c0c1610db tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087884 Jun 15 10:20:25.278176 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 445/908] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 10:20:25 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:20:26.129789 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f930bf3a-40b9-4fc7-bd68-7d4bcaf66a09 req-d3ae1a9c-b55c-4f2f-94ef-c26a8cbe8cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297abce4-955d-4411-8d84-3b14a31c5f19", "tag": "0b2590ec-78e7-4638-85b3-4f3cb8ab82ec"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:20:26.138420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f930bf3a-40b9-4fc7-bd68-7d4bcaf66a09 req-d3ae1a9c-b55c-4f2f-94ef-c26a8cbe8cc0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:26.138916 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f930bf3a-40b9-4fc7-bd68-7d4bcaf66a09 req-d3ae1a9c-b55c-4f2f-94ef-c26a8cbe8cc0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:26.143612 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:26.151301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f930bf3a-40b9-4fc7-bd68-7d4bcaf66a09 req-d3ae1a9c-b55c-4f2f-94ef-c26a8cbe8cc0 service nova] Creating event network-changed:0b2590ec-78e7-4638-85b3-4f3cb8ab82ec for instance 297abce4-955d-4411-8d84-3b14a31c5f19 on hv-cinder-83028 Jun 15 10:20:26.158474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f930bf3a-40b9-4fc7-bd68-7d4bcaf66a09 req-d3ae1a9c-b55c-4f2f-94ef-c26a8cbe8cc0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032347 Jun 15 10:20:26.159072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 464/909] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:20:28.176153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-0429d615-9d07-432f-b772-fbe20e3e4828 req-6c04746d-0b7c-4fa7-b4a2-ab669d6ae7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297abce4-955d-4411-8d84-3b14a31c5f19", "tag": "0b2590ec-78e7-4638-85b3-4f3cb8ab82ec"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:20:28.186939 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-0429d615-9d07-432f-b772-fbe20e3e4828 req-6c04746d-0b7c-4fa7-b4a2-ab669d6ae7d0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:28.187405 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-0429d615-9d07-432f-b772-fbe20e3e4828 req-6c04746d-0b7c-4fa7-b4a2-ab669d6ae7d0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:28.198238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-0429d615-9d07-432f-b772-fbe20e3e4828 req-6c04746d-0b7c-4fa7-b4a2-ab669d6ae7d0 service nova] Creating event network-changed:0b2590ec-78e7-4638-85b3-4f3cb8ab82ec for instance 297abce4-955d-4411-8d84-3b14a31c5f19 on hv-cinder-83028 Jun 15 10:20:28.208535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-0429d615-9d07-432f-b772-fbe20e3e4828 req-6c04746d-0b7c-4fa7-b4a2-ab669d6ae7d0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034862 Jun 15 10:20:28.209182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 446/910] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:20:47.343284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=13 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:47.348433 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8cf5c7f4-11d6-4b80-b0d5-2a137a12d1d1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:47.349045 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8cf5c7f4-11d6-4b80-b0d5-2a137a12d1d1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:47.356313 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8cf5c7f4-11d6-4b80-b0d5-2a137a12d1d1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:47.356761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8cf5c7f4-11d6-4b80-b0d5-2a137a12d1d1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:47.357656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8cf5c7f4-11d6-4b80-b0d5-2a137a12d1d1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:47.358105 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8cf5c7f4-11d6-4b80-b0d5-2a137a12d1d1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:47.386026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8cf5c7f4-11d6-4b80-b0d5-2a137a12d1d1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments/8f3facd6-6fdf-4ee5-b6f8-4f0f644b0cee" status: 200 len: 194 microversion: 2.20 time: 0.045287 Jun 15 10:20:47.386626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 465/911] 10.222.0.57 () {60 vars in 1453 bytes} [Wed Jun 15 10:20:47 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments/8f3facd6-6fdf-4ee5-b6f8-4f0f644b0cee => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:20:47.445602 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=27 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:47.446360 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=51 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:47.450704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5659e4b8-e358-4654-8d39-f7453a7be87e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:47.451874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5659e4b8-e358-4654-8d39-f7453a7be87e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:47.458712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5659e4b8-e358-4654-8d39-f7453a7be87e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:47.459151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5659e4b8-e358-4654-8d39-f7453a7be87e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:47.459902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5659e4b8-e358-4654-8d39-f7453a7be87e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:47.460335 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5659e4b8-e358-4654-8d39-f7453a7be87e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:47.539310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-5659e4b8-e358-4654-8d39-f7453a7be87e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lazy-loading 'services' on Instance uuid af5ab626-a7eb-407e-b8a9-a768e57d4022 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:20:47.615666 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5659e4b8-e358-4654-8d39-f7453a7be87e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "DELETE /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments/8f3facd6-6fdf-4ee5-b6f8-4f0f644b0cee" status: 202 len: 0 microversion: 2.20 time: 0.171349 Jun 15 10:20:47.616241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 447/912] 10.222.0.57 () {60 vars in 1456 bytes} [Wed Jun 15 10:20:47 2022] DELETE /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments/8f3facd6-6fdf-4ee5-b6f8-4f0f644b0cee => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:47.625353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9bc31159-0ae3-464d-a906-6dfa879102cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:47.626297 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9bc31159-0ae3-464d-a906-6dfa879102cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:47.632419 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bc31159-0ae3-464d-a906-6dfa879102cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:47.632851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bc31159-0ae3-464d-a906-6dfa879102cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:47.633665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bc31159-0ae3-464d-a906-6dfa879102cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:47.634069 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bc31159-0ae3-464d-a906-6dfa879102cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:47.665502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9bc31159-0ae3-464d-a906-6dfa879102cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044862 Jun 15 10:20:47.666062 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 466/913] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Jun 15 10:20:47 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:20:48.678352 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eeebe4a7-eecf-4941-93e2-32346aaadd1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:48.679438 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eeebe4a7-eecf-4941-93e2-32346aaadd1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:48.685544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eeebe4a7-eecf-4941-93e2-32346aaadd1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:48.686166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eeebe4a7-eecf-4941-93e2-32346aaadd1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:48.686960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eeebe4a7-eecf-4941-93e2-32346aaadd1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:48.687393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eeebe4a7-eecf-4941-93e2-32346aaadd1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:48.715776 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eeebe4a7-eecf-4941-93e2-32346aaadd1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042238 Jun 15 10:20:48.716255 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 448/914] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Jun 15 10:20:48 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:20:49.728356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-44f44df9-4a42-4d01-aec7-9ab45403153d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:49.729303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-44f44df9-4a42-4d01-aec7-9ab45403153d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:49.736422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44f44df9-4a42-4d01-aec7-9ab45403153d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:49.736880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44f44df9-4a42-4d01-aec7-9ab45403153d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:49.737652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44f44df9-4a42-4d01-aec7-9ab45403153d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:49.738095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44f44df9-4a42-4d01-aec7-9ab45403153d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:49.765836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-44f44df9-4a42-4d01-aec7-9ab45403153d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041484 Jun 15 10:20:49.766412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 467/915] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Jun 15 10:20:49 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:49.822662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-01d6e2da-d75f-4706-afe8-1c42f13882b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:49.823176 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-01d6e2da-d75f-4706-afe8-1c42f13882b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:49.829678 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01d6e2da-d75f-4706-afe8-1c42f13882b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:49.830126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01d6e2da-d75f-4706-afe8-1c42f13882b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:49.830917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01d6e2da-d75f-4706-afe8-1c42f13882b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:49.831355 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01d6e2da-d75f-4706-afe8-1c42f13882b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:49.859329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-01d6e2da-d75f-4706-afe8-1c42f13882b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:20:49.936906 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-01d6e2da-d75f-4706-afe8-1c42f13882b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "DELETE /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 204 len: 0 microversion: 2.20 time: 0.117772 Jun 15 10:20:49.937603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 449/916] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Jun 15 10:20:49 2022] DELETE /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:20:49.945915 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:49.946548 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:49.952722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:49.953232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:49.954030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:49.954538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:50.088502 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:50.097388 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:50.098973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:50.100146 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cf5cc5e2-9603-445c-9e5e-2a8e4feca024 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.158198 Jun 15 10:20:50.100700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 468/917] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:20:49 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:20:51.119874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:51.120581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:51.127381 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:51.127837 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:51.128654 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:51.129096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:51.262828 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:51.271840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:51.273338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:51.274533 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8cd3f998-3bb6-4045-bd9c-fdb6ec1a9994 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.159074 Jun 15 10:20:51.275083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 450/918] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:20:51 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:20:52.292628 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:52.293326 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:52.300661 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:52.301104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:52.301860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:52.302323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:52.431817 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:52.439868 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:52.441465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:52.442755 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-27262216-9b96-44a1-86ef-72b3914cf645 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1722 microversion: 2.20 time: 0.153992 Jun 15 10:20:52.443401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 469/919] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:20:52 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:20:53.011342 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-080eb89a-7d72-44c7-abab-edfed834fa27 req-b26b9145-ef29-4b94-ae4c-21fddaff641f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5ab626-a7eb-407e-b8a9-a768e57d4022", "name": "network-vif-deleted", "tag": "2021b47d-9010-4d70-8020-0269285a0559"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:20:53.022366 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-080eb89a-7d72-44c7-abab-edfed834fa27 req-b26b9145-ef29-4b94-ae4c-21fddaff641f service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:53.022821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-080eb89a-7d72-44c7-abab-edfed834fa27 req-b26b9145-ef29-4b94-ae4c-21fddaff641f service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:53.036429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-080eb89a-7d72-44c7-abab-edfed834fa27 req-b26b9145-ef29-4b94-ae4c-21fddaff641f service nova] Creating event network-vif-deleted:2021b47d-9010-4d70-8020-0269285a0559 for instance af5ab626-a7eb-407e-b8a9-a768e57d4022 on hv-cinder-83028 Jun 15 10:20:53.042845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-080eb89a-7d72-44c7-abab-edfed834fa27 req-b26b9145-ef29-4b94-ae4c-21fddaff641f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035301 Jun 15 10:20:53.046436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 451/920] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:20:53.462663 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:53.463880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:53.472078 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:53.472991 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:53.474052 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:53.474746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:53.509005 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:53.509463 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:53.509921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lazy-loading 'fault' on Instance uuid af5ab626-a7eb-407e-b8a9-a768e57d4022 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:20:53.558127 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:53.567880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:53.569469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:53.570762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8be20dfd-5725-4b8e-840a-88282217c899 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 200 len: 1371 microversion: 2.20 time: 0.112771 Jun 15 10:20:53.571623 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 470/921] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:20:53 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:20:54.590773 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:54.592045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:54.599130 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:54.599575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:54.600338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:54.600775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:54.614064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] HTTP exception thrown: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Request method failure captured: Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 HTTP/1.1 Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDTIqMqN40B5fLpN7fbdtXu8mBUJrYw096JtCI8GCBR5Cl8ZpYNzjwDWf7MCR0-ZLWhrOKhct60o_YJX2-UGhwMyAaUq5SFiyWFTpwSsBhwMhHrzA3asy8GlEITk0bsoIN6Ud6D0W-Fj3e3O--ByX8Jn6i6dE4vOGrirc1HRskthU8 Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:20:54.615742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f30e2cce69fb4e9bba7c053c4a37ba07", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 021e68642b0d4384bf3ece64e8e2ad69 Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:20:54.617434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'af5ab626-a7eb-407e-b8a9-a768e57d4022'} Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:20:54.618288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:20:54.619578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:20:54.620711 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Returning 404 to user: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:20:54.620711 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-30a02cf3-f863-4d8b-baa3-d9840ab67dbb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 404 len: 111 microversion: 2.20 time: 0.030689 Jun 15 10:20:54.620711 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 452/922] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:20:54 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:20:54.626210 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1281af74-67da-42c6-8984-2d27867f2624 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '.version_select at 0x7fe255ef14c0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:54.648542 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1281af74-67da-42c6-8984-2d27867f2624 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213979694" status: 204 len: 0 microversion: 2.20 time: 0.026199 Jun 15 10:20:54.649115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 471/923] 10.222.0.57 () {60 vars in 1261 bytes} [Wed Jun 15 10:20:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213979694 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:20:55.558990 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3496d76f-64b4-4b01-a818-ac72c0317223 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'create', calling method: .version_select at 0x7fe255dd63a0>, body: {"keypair": {"name": "tempest-keypair-1349756906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz/6tZ+eML8VRf6R34u7yxFIio0HuX3drTl9+4qc6AmKJjmFHG3dmo5CyMhg9YEei/Gj2v+cfoQg6EZjZd9BaFtA7V1sD3meFYP7Rp5iNPoo9yxAVZwlbWvjbZnQZvDDw=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:20:55.573274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-3496d76f-64b4-4b01-a818-ac72c0317223 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Getting quotas for project f30e2cce69fb4e9bba7c053c4a37ba07. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:20:55.577847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-3496d76f-64b4-4b01-a818-ac72c0317223 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Getting quotas for user 021e68642b0d4384bf3ece64e8e2ad69 and project f30e2cce69fb4e9bba7c053c4a37ba07. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:20:55.601134 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3496d76f-64b4-4b01-a818-ac72c0317223 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046149 Jun 15 10:20:55.606960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 453/924] 10.222.0.57 () {62 vars in 1199 bytes} [Wed Jun 15 10:20:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 10:20:56.876956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2070676439", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a926aae-ec26-461f-9351-b7dd3268c1ac"}], "security_groups": [{"name": "tempest-securitygroup--158522927"}], "key_name": "tempest-keypair-1349756906", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:20:56.977535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] validate_networks() for [('1a926aae-ec26-461f-9351-b7dd3268c1ac', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:20:57.349359 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:20:57.349795 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:20:57.350304 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:20:57.350716 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:20:57.351157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:20:57.359820 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:57.360273 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:57.361080 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:57.361520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:57.378387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Getting quotas for project f30e2cce69fb4e9bba7c053c4a37ba07. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:20:57.382345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Getting quotas for user 021e68642b0d4384bf3ece64e8e2ad69 and project f30e2cce69fb4e9bba7c053c4a37ba07. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:20:57.393643 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:20:57.395929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:20:57.440857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-17acfcc4-f477-44ad-815f-ac5f3e7e20c9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.569292 Jun 15 10:20:57.441488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 472/925] 10.222.0.57 () {62 vars in 1187 bytes} [Wed Jun 15 10:20:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 10:20:57.451929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ef7a91a4-ca30-4001-b653-e95e27d892a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:57.452537 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ef7a91a4-ca30-4001-b653-e95e27d892a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:57.507076 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ef7a91a4-ca30-4001-b653-e95e27d892a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:57.514938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ef7a91a4-ca30-4001-b653-e95e27d892a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:57.516469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ef7a91a4-ca30-4001-b653-e95e27d892a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:57.517616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ef7a91a4-ca30-4001-b653-e95e27d892a5 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1282 microversion: 2.20 time: 0.070105 Jun 15 10:20:57.518212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 454/926] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:20:57 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:20:58.535930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:58.536544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:58.543347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:58.543810 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:58.544948 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:58.545579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:58.614875 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:58.622897 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:58.624405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:58.625512 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-529f933b-d780-4606-b52a-f73f060c51fb tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1340 microversion: 2.20 time: 0.094025 Jun 15 10:20:58.626067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 473/927] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:20:58 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:20:59.644107 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:20:59.644779 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:20:59.652526 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:59.652982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:59.653812 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:20:59.654307 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:20:59.804028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:59.813026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:59.814663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:20:59.815773 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1e6ff1c6-031f-4f9b-8f83-c53259de01b9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.175684 Jun 15 10:20:59.816330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 455/928] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:20:59 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:00.160139 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-1b217e97-20b0-49c6-8eb3-a7e5f7fabd03 req-0ce5d68e-d92e-4c0a-b073-7da5e0b586ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3", "tag": "132b131d-7c10-4f96-96c1-cc640e8d71a7"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:00.170544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-1b217e97-20b0-49c6-8eb3-a7e5f7fabd03 req-0ce5d68e-d92e-4c0a-b073-7da5e0b586ad service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:00.171341 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-1b217e97-20b0-49c6-8eb3-a7e5f7fabd03 req-0ce5d68e-d92e-4c0a-b073-7da5e0b586ad service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:00.182779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-1b217e97-20b0-49c6-8eb3-a7e5f7fabd03 req-0ce5d68e-d92e-4c0a-b073-7da5e0b586ad service nova] Creating event network-changed:132b131d-7c10-4f96-96c1-cc640e8d71a7 for instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 on hv-cinder-83028 Jun 15 10:21:00.188588 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-1b217e97-20b0-49c6-8eb3-a7e5f7fabd03 req-0ce5d68e-d92e-4c0a-b073-7da5e0b586ad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032225 Jun 15 10:21:00.189270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 474/929] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:00.834428 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:00.834989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:00.842358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:00.842843 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:00.843612 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:00.844077 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:00.978709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:00.986981 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:00.988528 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:00.989677 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0851c6f7-2ea5-4171-be9e-208d665556b8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.159271 Jun 15 10:21:00.990239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 456/930] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:00 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:02.009390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:02.010094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:02.016547 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:02.016999 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:02.017761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:02.018200 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:02.150082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:02.159015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:02.160539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:02.161627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-80aa8949-14c4-479f-9921-cd047391a05c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.157594 Jun 15 10:21:02.162214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 475/931] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:02 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:02.678593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-56dca3d6-27c2-4f09-9ba1-28cfeaba8567 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:02.679158 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-56dca3d6-27c2-4f09-9ba1-28cfeaba8567 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:02.686262 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-56dca3d6-27c2-4f09-9ba1-28cfeaba8567 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:02.686740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-56dca3d6-27c2-4f09-9ba1-28cfeaba8567 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:02.687511 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-56dca3d6-27c2-4f09-9ba1-28cfeaba8567 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:02.687957 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-56dca3d6-27c2-4f09-9ba1-28cfeaba8567 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:02.711657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-56dca3d6-27c2-4f09-9ba1-28cfeaba8567 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lazy-loading 'flavor' on Instance uuid 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:21:02.782883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-56dca3d6-27c2-4f09-9ba1-28cfeaba8567 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "POST /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74/action" status: 202 len: 0 microversion: 2.1 time: 0.108000 Jun 15 10:21:02.783472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 457/932] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:21:02 2022] POST /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:21:02.791579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-880a5486-4a1f-4741-b9b9-af51efa28b5f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:02.792194 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-880a5486-4a1f-4741-b9b9-af51efa28b5f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:02.798322 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-880a5486-4a1f-4741-b9b9-af51efa28b5f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:02.798779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-880a5486-4a1f-4741-b9b9-af51efa28b5f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:02.799581 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-880a5486-4a1f-4741-b9b9-af51efa28b5f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:02.800022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-880a5486-4a1f-4741-b9b9-af51efa28b5f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:02.930850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-880a5486-4a1f-4741-b9b9-af51efa28b5f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:02.938495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-880a5486-4a1f-4741-b9b9-af51efa28b5f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.150683 Jun 15 10:21:02.939061 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 476/933] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:02 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:03.180319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:03.181075 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:03.188600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:03.189045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:03.189820 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:03.190849 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:03.322308 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:03.330793 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:03.332279 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:03.333371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-50ce3787-897e-4a3e-a3eb-4db977cf97ca tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.157541 Jun 15 10:21:03.333920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 458/934] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:03 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:03.955424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-79540d90-01af-4090-bc98-d415f71ddbb0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:03.956071 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-79540d90-01af-4090-bc98-d415f71ddbb0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:03.962573 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79540d90-01af-4090-bc98-d415f71ddbb0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:03.963028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79540d90-01af-4090-bc98-d415f71ddbb0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:03.963824 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79540d90-01af-4090-bc98-d415f71ddbb0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:03.964328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-79540d90-01af-4090-bc98-d415f71ddbb0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:04.111545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-79540d90-01af-4090-bc98-d415f71ddbb0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:04.119597 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-79540d90-01af-4090-bc98-d415f71ddbb0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.167947 Jun 15 10:21:04.120262 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 477/935] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:03 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:04.351404 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:04.351955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:04.358517 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:04.358955 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:04.359714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:04.360143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:04.496084 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:04.504613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:04.506152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:04.507306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-97f52d3b-ad4e-4b6d-a90f-ed0023537aa7 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.159890 Jun 15 10:21:04.507858 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 459/936] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:04 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:05.136876 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cb5b3d74-2c99-47ab-a263-43d5baaa01d0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:05.137590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cb5b3d74-2c99-47ab-a263-43d5baaa01d0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:05.144124 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb5b3d74-2c99-47ab-a263-43d5baaa01d0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:05.144582 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb5b3d74-2c99-47ab-a263-43d5baaa01d0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:05.145349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb5b3d74-2c99-47ab-a263-43d5baaa01d0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:05.145796 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb5b3d74-2c99-47ab-a263-43d5baaa01d0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:05.278731 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cb5b3d74-2c99-47ab-a263-43d5baaa01d0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:05.286310 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cb5b3d74-2c99-47ab-a263-43d5baaa01d0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.153291 Jun 15 10:21:05.286889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 478/937] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:05 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:05.525848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:05.526489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:05.533891 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:05.534373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:05.535139 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:05.535574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:05.663728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:05.672246 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:05.673742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:05.674886 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-30735910-4c82-4390-abcb-bbe2ab452e0b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.153030 Jun 15 10:21:05.675441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 460/938] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:05 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:06.304294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-4ddb2eb9-9d6c-4210-9925-03e018a605fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:06.304843 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-4ddb2eb9-9d6c-4210-9925-03e018a605fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:06.311956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ddb2eb9-9d6c-4210-9925-03e018a605fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:06.312414 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ddb2eb9-9d6c-4210-9925-03e018a605fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:06.313185 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ddb2eb9-9d6c-4210-9925-03e018a605fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:06.313628 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-4ddb2eb9-9d6c-4210-9925-03e018a605fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:06.449023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-4ddb2eb9-9d6c-4210-9925-03e018a605fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:06.457353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-4ddb2eb9-9d6c-4210-9925-03e018a605fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.157062 Jun 15 10:21:06.457951 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 479/939] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:06 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:06.692168 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:06.692781 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:06.699322 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:06.699821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:06.701157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:06.701601 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:06.831986 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:06.839889 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:06.841652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:06.842791 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-190d4304-e262-44ec-b8e2-f3364259a3cd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.154543 Jun 15 10:21:06.843353 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 461/940] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:06 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:07.344239 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-1894d8b4-fc7d-418d-a7a7-ac3985050c33 req-5f71a0a2-ef44-4ff7-8fc7-1536018dfb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3", "name": "network-vif-plugged", "status": "completed", "tag": "132b131d-7c10-4f96-96c1-cc640e8d71a7"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:07.353302 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-1894d8b4-fc7d-418d-a7a7-ac3985050c33 req-5f71a0a2-ef44-4ff7-8fc7-1536018dfb2c service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:07.353970 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-1894d8b4-fc7d-418d-a7a7-ac3985050c33 req-5f71a0a2-ef44-4ff7-8fc7-1536018dfb2c service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:07.365261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-1894d8b4-fc7d-418d-a7a7-ac3985050c33 req-5f71a0a2-ef44-4ff7-8fc7-1536018dfb2c service nova] Creating event network-vif-plugged:132b131d-7c10-4f96-96c1-cc640e8d71a7 for instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 on hv-cinder-83028 Jun 15 10:21:07.368713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.370449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-1894d8b4-fc7d-418d-a7a7-ac3985050c33 req-5f71a0a2-ef44-4ff7-8fc7-1536018dfb2c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030606 Jun 15 10:21:07.371051 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 480/941] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:07.475261 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dcf1de68-d243-46c7-bab8-085f22713bfe tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:07.475903 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dcf1de68-d243-46c7-bab8-085f22713bfe tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:07.482076 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dcf1de68-d243-46c7-bab8-085f22713bfe tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:07.482559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dcf1de68-d243-46c7-bab8-085f22713bfe tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:07.483327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dcf1de68-d243-46c7-bab8-085f22713bfe tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:07.483767 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dcf1de68-d243-46c7-bab8-085f22713bfe tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:07.502933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.516127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=6 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.627709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dcf1de68-d243-46c7-bab8-085f22713bfe tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:07.635631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dcf1de68-d243-46c7-bab8-085f22713bfe tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.164546 Jun 15 10:21:07.636562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 462/942] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:07 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:07.857163 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.861399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:07.862091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:07.869104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:07.869550 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:07.870346 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:07.870780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:08.000418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:08.013321 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:08.014844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:08.015950 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8a641827-5c1b-4e9c-aebb-f8b66abd96a9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.159663 Jun 15 10:21:08.016501 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 481/943] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:07 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:08.655581 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a92a4a34-1949-4b00-a9c3-acd73f5c1e21 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:08.656199 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a92a4a34-1949-4b00-a9c3-acd73f5c1e21 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:08.662660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a92a4a34-1949-4b00-a9c3-acd73f5c1e21 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:08.663111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a92a4a34-1949-4b00-a9c3-acd73f5c1e21 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:08.663881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a92a4a34-1949-4b00-a9c3-acd73f5c1e21 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:08.664324 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a92a4a34-1949-4b00-a9c3-acd73f5c1e21 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:08.809712 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a92a4a34-1949-4b00-a9c3-acd73f5c1e21 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:08.817447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a92a4a34-1949-4b00-a9c3-acd73f5c1e21 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.166708 Jun 15 10:21:08.818421 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 482/944] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:08 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:08.828637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-16ec098b-5387-4267-b1b1-bd11faca462e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:08.829135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-16ec098b-5387-4267-b1b1-bd11faca462e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:08.835348 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16ec098b-5387-4267-b1b1-bd11faca462e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:08.835743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16ec098b-5387-4267-b1b1-bd11faca462e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:08.836508 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16ec098b-5387-4267-b1b1-bd11faca462e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:08.836979 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16ec098b-5387-4267-b1b1-bd11faca462e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:08.924484 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-16ec098b-5387-4267-b1b1-bd11faca462e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lazy-loading 'services' on Instance uuid 7367c589-27eb-4ff0-860e-d6a676c70441 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:21:08.997250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-16ec098b-5387-4267-b1b1-bd11faca462e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/os-volume_attachments/cdfc2020-79a4-4d63-818f-fadf464dfcd4" status: 202 len: 0 microversion: 2.1 time: 0.355592 Jun 15 10:21:08.997841 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 463/945] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:21:08 2022] DELETE /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/os-volume_attachments/cdfc2020-79a4-4d63-818f-fadf464dfcd4 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:21:09.034681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:09.035290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:09.042091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:09.043065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:09.044107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:09.044572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:09.180909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:09.189360 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:09.190910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:09.192026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a0e4287c-7a6b-471d-89ba-12518b41868a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1407 microversion: 2.20 time: 0.161386 Jun 15 10:21:09.192582 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 483/946] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:09 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:09.837022 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a6e934a4-86cf-427c-851b-e3ba06334ed5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:09.837722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a6e934a4-86cf-427c-851b-e3ba06334ed5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:09.844048 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6e934a4-86cf-427c-851b-e3ba06334ed5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:09.844496 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6e934a4-86cf-427c-851b-e3ba06334ed5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:09.845259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6e934a4-86cf-427c-851b-e3ba06334ed5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:09.845694 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6e934a4-86cf-427c-851b-e3ba06334ed5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:09.978440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a6e934a4-86cf-427c-851b-e3ba06334ed5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:09.986636 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a6e934a4-86cf-427c-851b-e3ba06334ed5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.154383 Jun 15 10:21:09.987200 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 464/947] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:09 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:10.210399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:10.211007 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:10.217923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:10.218393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:10.219149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:10.219582 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:10.223632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:10.357751 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:10.365719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:10.367250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:10.368663 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e235b4c9-c298-43ff-9bf1-355cccb1c40f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1598 microversion: 2.20 time: 0.162201 Jun 15 10:21:10.369222 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 484/948] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:21:10 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:21:10.386807 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6e8b653a-5180-4ec3-8281-33aa8d70f1d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:10.387941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6e8b653a-5180-4ec3-8281-33aa8d70f1d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:10.394037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e8b653a-5180-4ec3-8281-33aa8d70f1d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:10.394559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e8b653a-5180-4ec3-8281-33aa8d70f1d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:10.395334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e8b653a-5180-4ec3-8281-33aa8d70f1d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:10.395775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6e8b653a-5180-4ec3-8281-33aa8d70f1d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:10.474287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6e8b653a-5180-4ec3-8281-33aa8d70f1d9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091781 Jun 15 10:21:10.474915 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 465/949] 10.222.0.57 () {60 vars in 1315 bytes} [Wed Jun 15 10:21:10 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:21:11.004145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fd877028-6bd0-4459-911a-45eb43b6e8b3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:11.004673 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fd877028-6bd0-4459-911a-45eb43b6e8b3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:11.010664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd877028-6bd0-4459-911a-45eb43b6e8b3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:11.011118 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd877028-6bd0-4459-911a-45eb43b6e8b3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:11.011897 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd877028-6bd0-4459-911a-45eb43b6e8b3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:11.012947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fd877028-6bd0-4459-911a-45eb43b6e8b3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:11.177091 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4f9a7256-4cc7-4a8e-8864-b1b15b530a52 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:11.183095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f9a7256-4cc7-4a8e-8864-b1b15b530a52 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:11.183552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f9a7256-4cc7-4a8e-8864-b1b15b530a52 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:11.232584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fd877028-6bd0-4459-911a-45eb43b6e8b3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:11.240396 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fd877028-6bd0-4459-911a-45eb43b6e8b3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.240273 Jun 15 10:21:11.241823 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 485/950] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:10 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:11.249046 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4f9a7256-4cc7-4a8e-8864-b1b15b530a52 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Going to try to stop instance {{(pid=117721) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 10:21:11.291602 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4f9a7256-4cc7-4a8e-8864-b1b15b530a52 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/action" status: 202 len: 0 microversion: 2.1 time: 0.118528 Jun 15 10:21:11.292136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 466/951] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:21:11 2022] POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:21:11.310703 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7d773a32-49ce-4df0-b23f-5c9c7ddc930e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:11.311348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7d773a32-49ce-4df0-b23f-5c9c7ddc930e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:11.317580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d773a32-49ce-4df0-b23f-5c9c7ddc930e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:11.318033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d773a32-49ce-4df0-b23f-5c9c7ddc930e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:11.318838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d773a32-49ce-4df0-b23f-5c9c7ddc930e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:11.319282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7d773a32-49ce-4df0-b23f-5c9c7ddc930e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:11.561234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7d773a32-49ce-4df0-b23f-5c9c7ddc930e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:11.568911 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7d773a32-49ce-4df0-b23f-5c9c7ddc930e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.263920 Jun 15 10:21:11.578743 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-ddccb415-a497-48c9-88ac-713048df2ad9 req-5565da71-6b1b-4ee0-aaaf-7662905279c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3", "tag": "132b131d-7c10-4f96-96c1-cc640e8d71a7"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:11.578956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 486/952] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:11 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:11.579075 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ddccb415-a497-48c9-88ac-713048df2ad9 req-5565da71-6b1b-4ee0-aaaf-7662905279c6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:11.579075 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ddccb415-a497-48c9-88ac-713048df2ad9 req-5565da71-6b1b-4ee0-aaaf-7662905279c6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:11.590565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-ddccb415-a497-48c9-88ac-713048df2ad9 req-5565da71-6b1b-4ee0-aaaf-7662905279c6 service nova] Creating event network-changed:132b131d-7c10-4f96-96c1-cc640e8d71a7 for instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 on hv-cinder-83028 Jun 15 10:21:11.595689 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-ddccb415-a497-48c9-88ac-713048df2ad9 req-5565da71-6b1b-4ee0-aaaf-7662905279c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030117 Jun 15 10:21:11.596734 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 467/953] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:21:12.259327 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-faada21a-344e-4044-833a-69e8a7f43b34 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:12.260056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-faada21a-344e-4044-833a-69e8a7f43b34 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:12.267034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-faada21a-344e-4044-833a-69e8a7f43b34 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:12.267595 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-faada21a-344e-4044-833a-69e8a7f43b34 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:12.268350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-faada21a-344e-4044-833a-69e8a7f43b34 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:12.268786 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-faada21a-344e-4044-833a-69e8a7f43b34 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:12.408346 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-faada21a-344e-4044-833a-69e8a7f43b34 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:12.416261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-faada21a-344e-4044-833a-69e8a7f43b34 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.160693 Jun 15 10:21:12.416867 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 487/954] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:12 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:12.586692 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b3358956-f009-4941-a9ef-c36f1a14328a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:12.587435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b3358956-f009-4941-a9ef-c36f1a14328a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:12.594975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3358956-f009-4941-a9ef-c36f1a14328a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:12.595430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3358956-f009-4941-a9ef-c36f1a14328a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:12.596455 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3358956-f009-4941-a9ef-c36f1a14328a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:12.596902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b3358956-f009-4941-a9ef-c36f1a14328a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:12.731800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b3358956-f009-4941-a9ef-c36f1a14328a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:12.739485 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b3358956-f009-4941-a9ef-c36f1a14328a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.157623 Jun 15 10:21:12.740067 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 468/955] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:12 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:13.434762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-75180415-a815-44ab-9b40-daeeb2c3c1fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:13.437727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-75180415-a815-44ab-9b40-daeeb2c3c1fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:13.442209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-75180415-a815-44ab-9b40-daeeb2c3c1fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:13.442692 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-75180415-a815-44ab-9b40-daeeb2c3c1fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:13.443456 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-75180415-a815-44ab-9b40-daeeb2c3c1fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:13.443891 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-75180415-a815-44ab-9b40-daeeb2c3c1fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:13.583914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-75180415-a815-44ab-9b40-daeeb2c3c1fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:13.592113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-75180415-a815-44ab-9b40-daeeb2c3c1fc tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.161733 Jun 15 10:21:13.592665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 488/956] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:13 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:13.757432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-88642dae-a9bd-4397-875e-7010cf94d982 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:13.758001 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-88642dae-a9bd-4397-875e-7010cf94d982 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:13.765850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88642dae-a9bd-4397-875e-7010cf94d982 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:13.766317 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88642dae-a9bd-4397-875e-7010cf94d982 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:13.767081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88642dae-a9bd-4397-875e-7010cf94d982 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:13.767512 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88642dae-a9bd-4397-875e-7010cf94d982 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:13.893530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-88642dae-a9bd-4397-875e-7010cf94d982 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:13.901088 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-88642dae-a9bd-4397-875e-7010cf94d982 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.148047 Jun 15 10:21:13.901696 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 469/957] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:13 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:14.609836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f84000b6-5bab-4b6f-b1ca-92dec4da7774 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:14.610480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f84000b6-5bab-4b6f-b1ca-92dec4da7774 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:14.616995 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f84000b6-5bab-4b6f-b1ca-92dec4da7774 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:14.617449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f84000b6-5bab-4b6f-b1ca-92dec4da7774 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:14.618211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f84000b6-5bab-4b6f-b1ca-92dec4da7774 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:14.618675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f84000b6-5bab-4b6f-b1ca-92dec4da7774 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:14.750849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f84000b6-5bab-4b6f-b1ca-92dec4da7774 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:14.758399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f84000b6-5bab-4b6f-b1ca-92dec4da7774 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.153339 Jun 15 10:21:14.758980 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 489/958] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:14 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:14.918161 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a312ce50-dbd4-484e-98f0-bb171a586ee1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:14.918838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a312ce50-dbd4-484e-98f0-bb171a586ee1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:14.925257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a312ce50-dbd4-484e-98f0-bb171a586ee1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:14.925711 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a312ce50-dbd4-484e-98f0-bb171a586ee1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:14.926512 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a312ce50-dbd4-484e-98f0-bb171a586ee1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:14.926957 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a312ce50-dbd4-484e-98f0-bb171a586ee1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:15.054697 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a312ce50-dbd4-484e-98f0-bb171a586ee1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:15.062106 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a312ce50-dbd4-484e-98f0-bb171a586ee1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.147804 Jun 15 10:21:15.062712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 470/959] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:14 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:15.776177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-25c85f7e-e937-40a8-95b6-e276119a2a5c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:15.776846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-25c85f7e-e937-40a8-95b6-e276119a2a5c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:15.785065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-e937-40a8-95b6-e276119a2a5c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:15.785516 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-e937-40a8-95b6-e276119a2a5c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:15.786302 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-e937-40a8-95b6-e276119a2a5c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:15.786745 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-e937-40a8-95b6-e276119a2a5c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:15.917226 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-25c85f7e-e937-40a8-95b6-e276119a2a5c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:15.925424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-25c85f7e-e937-40a8-95b6-e276119a2a5c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.153362 Jun 15 10:21:15.926015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 490/960] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:15 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:16.079188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6654fa14-1f0d-4854-9761-b4b7985a965d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:16.079705 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6654fa14-1f0d-4854-9761-b4b7985a965d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:16.086045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6654fa14-1f0d-4854-9761-b4b7985a965d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:16.086568 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6654fa14-1f0d-4854-9761-b4b7985a965d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:16.087319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6654fa14-1f0d-4854-9761-b4b7985a965d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:16.087753 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6654fa14-1f0d-4854-9761-b4b7985a965d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:16.228182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6654fa14-1f0d-4854-9761-b4b7985a965d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:16.236195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6654fa14-1f0d-4854-9761-b4b7985a965d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.160957 Jun 15 10:21:16.236757 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 471/961] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:16 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:16.943484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d512ae40-d250-4e65-ba12-776a582e77da tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:16.944108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d512ae40-d250-4e65-ba12-776a582e77da tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:16.951872 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d512ae40-d250-4e65-ba12-776a582e77da tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:16.952330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d512ae40-d250-4e65-ba12-776a582e77da tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:16.953105 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d512ae40-d250-4e65-ba12-776a582e77da tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:16.953549 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d512ae40-d250-4e65-ba12-776a582e77da tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:17.085403 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d512ae40-d250-4e65-ba12-776a582e77da tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:17.092996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d512ae40-d250-4e65-ba12-776a582e77da tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.153340 Jun 15 10:21:17.093553 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 491/962] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:16 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:17.254174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b7bd598c-eb46-4e28-81ca-47e588e6df2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:17.254720 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b7bd598c-eb46-4e28-81ca-47e588e6df2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:17.261178 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b7bd598c-eb46-4e28-81ca-47e588e6df2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:17.261630 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b7bd598c-eb46-4e28-81ca-47e588e6df2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:17.262417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b7bd598c-eb46-4e28-81ca-47e588e6df2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:17.262856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b7bd598c-eb46-4e28-81ca-47e588e6df2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:17.612775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b7bd598c-eb46-4e28-81ca-47e588e6df2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:17.620231 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b7bd598c-eb46-4e28-81ca-47e588e6df2e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.369992 Jun 15 10:21:17.620794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 472/963] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:17 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:18.111040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-009fef19-5f40-4676-bf0b-b556b1a98465 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:18.111682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-009fef19-5f40-4676-bf0b-b556b1a98465 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:18.114089 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:18.119161 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-009fef19-5f40-4676-bf0b-b556b1a98465 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:18.119613 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-009fef19-5f40-4676-bf0b-b556b1a98465 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:18.120374 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-009fef19-5f40-4676-bf0b-b556b1a98465 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:18.120806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-009fef19-5f40-4676-bf0b-b556b1a98465 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:18.254503 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-009fef19-5f40-4676-bf0b-b556b1a98465 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:18.262055 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-009fef19-5f40-4676-bf0b-b556b1a98465 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.155564 Jun 15 10:21:18.262651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 492/964] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:18 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:18.638817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-45210f7e-d3f7-412e-ada7-370ca280a28f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:18.639457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-45210f7e-d3f7-412e-ada7-370ca280a28f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:18.641654 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:18.647039 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-45210f7e-d3f7-412e-ada7-370ca280a28f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:18.647487 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-45210f7e-d3f7-412e-ada7-370ca280a28f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:18.648256 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-45210f7e-d3f7-412e-ada7-370ca280a28f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:18.648689 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-45210f7e-d3f7-412e-ada7-370ca280a28f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:18.777963 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-45210f7e-d3f7-412e-ada7-370ca280a28f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:18.786007 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-45210f7e-d3f7-412e-ada7-370ca280a28f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.151784 Jun 15 10:21:18.786603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 473/965] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:18 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:19.279963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-51dc6634-b577-4671-a72a-b188dcd1cd6e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:19.280573 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-51dc6634-b577-4671-a72a-b188dcd1cd6e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:19.287548 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-51dc6634-b577-4671-a72a-b188dcd1cd6e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:19.287994 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-51dc6634-b577-4671-a72a-b188dcd1cd6e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:19.288759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-51dc6634-b577-4671-a72a-b188dcd1cd6e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:19.289191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-51dc6634-b577-4671-a72a-b188dcd1cd6e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:19.421080 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-51dc6634-b577-4671-a72a-b188dcd1cd6e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:19.429221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-51dc6634-b577-4671-a72a-b188dcd1cd6e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.153502 Jun 15 10:21:19.429800 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 493/966] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:19 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:19.802650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e955c385-0b6e-49b6-9905-0cf62f921b63 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:19.803259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e955c385-0b6e-49b6-9905-0cf62f921b63 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:19.809229 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e955c385-0b6e-49b6-9905-0cf62f921b63 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:19.809716 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e955c385-0b6e-49b6-9905-0cf62f921b63 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:19.810502 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e955c385-0b6e-49b6-9905-0cf62f921b63 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:19.810936 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e955c385-0b6e-49b6-9905-0cf62f921b63 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:19.943005 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e955c385-0b6e-49b6-9905-0cf62f921b63 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:19.950598 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e955c385-0b6e-49b6-9905-0cf62f921b63 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.151905 Jun 15 10:21:19.951178 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 474/967] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:19 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:20.448359 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-fe18fc3d-9169-4d64-814b-ac195b2bea4f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:20.448985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-fe18fc3d-9169-4d64-814b-ac195b2bea4f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:20.456356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fe18fc3d-9169-4d64-814b-ac195b2bea4f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:20.456812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fe18fc3d-9169-4d64-814b-ac195b2bea4f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:20.457701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fe18fc3d-9169-4d64-814b-ac195b2bea4f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:20.458148 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-fe18fc3d-9169-4d64-814b-ac195b2bea4f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:20.593215 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-fe18fc3d-9169-4d64-814b-ac195b2bea4f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:20.601057 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-fe18fc3d-9169-4d64-814b-ac195b2bea4f tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.156608 Jun 15 10:21:20.601625 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 494/968] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:20 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:20.968382 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8bfdc43a-7ab6-4355-b8e9-44264ad15782 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:20.968996 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8bfdc43a-7ab6-4355-b8e9-44264ad15782 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:20.975808 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfdc43a-7ab6-4355-b8e9-44264ad15782 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:20.976264 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfdc43a-7ab6-4355-b8e9-44264ad15782 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:20.977029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfdc43a-7ab6-4355-b8e9-44264ad15782 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:20.977472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8bfdc43a-7ab6-4355-b8e9-44264ad15782 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:21.103650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-8bfdc43a-7ab6-4355-b8e9-44264ad15782 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:21.112584 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8bfdc43a-7ab6-4355-b8e9-44264ad15782 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.147919 Jun 15 10:21:21.113204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 475/969] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:20 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:21.393335 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bb7ff4fd-9dac-4e42-9fac-273d4fb3266d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:21.394519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bb7ff4fd-9dac-4e42-9fac-273d4fb3266d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:21.400612 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb7ff4fd-9dac-4e42-9fac-273d4fb3266d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:21.401061 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb7ff4fd-9dac-4e42-9fac-273d4fb3266d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:21.401818 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb7ff4fd-9dac-4e42-9fac-273d4fb3266d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:21.402249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bb7ff4fd-9dac-4e42-9fac-273d4fb3266d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:21.473852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bb7ff4fd-9dac-4e42-9fac-273d4fb3266d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "POST /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/action" status: 202 len: 0 microversion: 2.1 time: 0.084211 Jun 15 10:21:21.477465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 495/970] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:21:21 2022] POST /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:21:21.484045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3184da04-8943-4649-8e11-53b211d3f6d4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:21.484665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3184da04-8943-4649-8e11-53b211d3f6d4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:21.492060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3184da04-8943-4649-8e11-53b211d3f6d4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:21.492528 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3184da04-8943-4649-8e11-53b211d3f6d4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:21.493575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3184da04-8943-4649-8e11-53b211d3f6d4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:21.494785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3184da04-8943-4649-8e11-53b211d3f6d4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:21.619411 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7db7937c-338c-49b3-a317-719cae2d9b65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:21.620046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7db7937c-338c-49b3-a317-719cae2d9b65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:21.626911 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7db7937c-338c-49b3-a317-719cae2d9b65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:21.627370 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7db7937c-338c-49b3-a317-719cae2d9b65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:21.628152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7db7937c-338c-49b3-a317-719cae2d9b65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:21.628595 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7db7937c-338c-49b3-a317-719cae2d9b65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:21.656850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3184da04-8943-4649-8e11-53b211d3f6d4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:21.665575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3184da04-8943-4649-8e11-53b211d3f6d4 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1751 microversion: 2.1 time: 0.186868 Jun 15 10:21:21.666247 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 476/971] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:21 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:21.775644 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7db7937c-338c-49b3-a317-719cae2d9b65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:21.784604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7db7937c-338c-49b3-a317-719cae2d9b65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.169408 Jun 15 10:21:21.785193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 496/972] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:21 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:22.129036 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-70b44788-3b58-4931-bd7b-8e5d809cde4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:22.129593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-70b44788-3b58-4931-bd7b-8e5d809cde4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:22.136227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70b44788-3b58-4931-bd7b-8e5d809cde4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:22.136682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70b44788-3b58-4931-bd7b-8e5d809cde4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:22.137450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70b44788-3b58-4931-bd7b-8e5d809cde4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:22.137901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-70b44788-3b58-4931-bd7b-8e5d809cde4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:22.269380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-70b44788-3b58-4931-bd7b-8e5d809cde4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:22.276984 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-70b44788-3b58-4931-bd7b-8e5d809cde4b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.151921 Jun 15 10:21:22.277891 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 477/973] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:22 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:22.683508 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6e1cffa4-cd30-4ff2-838f-fd6983630807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:22.684050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6e1cffa4-cd30-4ff2-838f-fd6983630807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:22.691135 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6e1cffa4-cd30-4ff2-838f-fd6983630807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:22.691593 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6e1cffa4-cd30-4ff2-838f-fd6983630807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:22.692364 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6e1cffa4-cd30-4ff2-838f-fd6983630807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:22.692808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6e1cffa4-cd30-4ff2-838f-fd6983630807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:22.803018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6007633a-6a8e-4443-8b12-249e4854a961 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:22.803663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6007633a-6a8e-4443-8b12-249e4854a961 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:22.810145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6007633a-6a8e-4443-8b12-249e4854a961 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:22.810638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6007633a-6a8e-4443-8b12-249e4854a961 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:22.811409 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6007633a-6a8e-4443-8b12-249e4854a961 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:22.811851 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6007633a-6a8e-4443-8b12-249e4854a961 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:22.830230 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:22.840091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6e1cffa4-cd30-4ff2-838f-fd6983630807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:22.848973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6e1cffa4-cd30-4ff2-838f-fd6983630807 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.169407 Jun 15 10:21:22.849889 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 497/974] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:22 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:22.946055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6007633a-6a8e-4443-8b12-249e4854a961 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:22.954817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6007633a-6a8e-4443-8b12-249e4854a961 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1507 microversion: 2.1 time: 0.155710 Jun 15 10:21:22.955390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 478/975] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:22 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:22.971442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-28fd66ef-b237-4495-8564-5e185f84786b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:22.972014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-28fd66ef-b237-4495-8564-5e185f84786b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:22.977969 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28fd66ef-b237-4495-8564-5e185f84786b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:22.978470 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28fd66ef-b237-4495-8564-5e185f84786b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:22.979222 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28fd66ef-b237-4495-8564-5e185f84786b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:22.979654 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-28fd66ef-b237-4495-8564-5e185f84786b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.039626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:23.052247 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-28fd66ef-b237-4495-8564-5e185f84786b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "POST /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74/action" status: 202 len: 0 microversion: 2.1 time: 0.084946 Jun 15 10:21:23.053012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 498/976] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:21:22 2022] POST /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:21:23.061355 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ce3bdc57-4325-459f-8b2a-039b34c5f264 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:23.062636 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ce3bdc57-4325-459f-8b2a-039b34c5f264 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:23.068673 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce3bdc57-4325-459f-8b2a-039b34c5f264 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.069132 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce3bdc57-4325-459f-8b2a-039b34c5f264 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.069904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce3bdc57-4325-459f-8b2a-039b34c5f264 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.070383 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ce3bdc57-4325-459f-8b2a-039b34c5f264 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.219250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ce3bdc57-4325-459f-8b2a-039b34c5f264 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:23.227070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ce3bdc57-4325-459f-8b2a-039b34c5f264 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1515 microversion: 2.1 time: 0.170115 Jun 15 10:21:23.227667 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 479/977] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:23 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:23.298538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-44fa3fea-6895-4034-ad09-cccf95a1c426 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:23.299193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-44fa3fea-6895-4034-ad09-cccf95a1c426 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:23.305347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44fa3fea-6895-4034-ad09-cccf95a1c426 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.305803 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44fa3fea-6895-4034-ad09-cccf95a1c426 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.307668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44fa3fea-6895-4034-ad09-cccf95a1c426 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.308122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44fa3fea-6895-4034-ad09-cccf95a1c426 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.346729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-264400a4-7f8b-4db1-928a-77312c0adbd3 req-eaa965ae-dfc8-4f1e-8abe-e7150171f6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017fbaea-de4e-4981-b1a7-f85fc6d5fc74", "name": "network-vif-unplugged", "status": "completed", "tag": "a0d42ef5-c08b-4c5d-807e-fde0e4998fd2"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:23.361915 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-264400a4-7f8b-4db1-928a-77312c0adbd3 req-eaa965ae-dfc8-4f1e-8abe-e7150171f6eb service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.362658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-264400a4-7f8b-4db1-928a-77312c0adbd3 req-eaa965ae-dfc8-4f1e-8abe-e7150171f6eb service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.379760 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.compute.server_external_events [req-264400a4-7f8b-4db1-928a-77312c0adbd3 req-eaa965ae-dfc8-4f1e-8abe-e7150171f6eb service nova] Unable to find a host for instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74. Dropping event network-vif-unplugged {{(pid=117721) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 10:21:23.380739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-264400a4-7f8b-4db1-928a-77312c0adbd3 req-eaa965ae-dfc8-4f1e-8abe-e7150171f6eb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040508 Jun 15 10:21:23.382162 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 480/978] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 15 10:21:23.461784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-44fa3fea-6895-4034-ad09-cccf95a1c426 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:23.470831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-44fa3fea-6895-4034-ad09-cccf95a1c426 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.177933 Jun 15 10:21:23.471631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 499/979] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:23 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:23.866687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-198c27eb-58af-4736-92b6-465b25fe1387 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:23.867303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-198c27eb-58af-4736-92b6-465b25fe1387 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:23.874204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-198c27eb-58af-4736-92b6-465b25fe1387 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.874690 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-198c27eb-58af-4736-92b6-465b25fe1387 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.875461 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-198c27eb-58af-4736-92b6-465b25fe1387 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.876300 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-198c27eb-58af-4736-92b6-465b25fe1387 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.940428 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e4c8dc02-0850-4b29-b5c5-d76dd9526258 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:23.940963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e4c8dc02-0850-4b29-b5c5-d76dd9526258 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:23.947372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4c8dc02-0850-4b29-b5c5-d76dd9526258 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.947826 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4c8dc02-0850-4b29-b5c5-d76dd9526258 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.948594 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4c8dc02-0850-4b29-b5c5-d76dd9526258 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:23.949034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e4c8dc02-0850-4b29-b5c5-d76dd9526258 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:23.976440 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e4c8dc02-0850-4b29-b5c5-d76dd9526258 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:21:24.032243 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-198c27eb-58af-4736-92b6-465b25fe1387 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:24.040788 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-198c27eb-58af-4736-92b6-465b25fe1387 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.177958 Jun 15 10:21:24.041376 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 481/980] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:23 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:24.060622 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e4c8dc02-0850-4b29-b5c5-d76dd9526258 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 204 len: 0 microversion: 2.1 time: 0.122764 Jun 15 10:21:24.061387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 500/981] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:21:23 2022] DELETE /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:24.069549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-54c0e58f-9ff2-42e7-85be-d6189487305e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:24.070320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-54c0e58f-9ff2-42e7-85be-d6189487305e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:24.077035 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54c0e58f-9ff2-42e7-85be-d6189487305e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:24.077479 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54c0e58f-9ff2-42e7-85be-d6189487305e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:24.078254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54c0e58f-9ff2-42e7-85be-d6189487305e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:24.078722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-54c0e58f-9ff2-42e7-85be-d6189487305e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:24.211881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-54c0e58f-9ff2-42e7-85be-d6189487305e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:24.219430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-54c0e58f-9ff2-42e7-85be-d6189487305e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1575 microversion: 2.1 time: 0.153792 Jun 15 10:21:24.219997 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 482/982] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:24 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:24.245211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6398a1cf-6ff7-4670-b26b-43652ed253c8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:24.245910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6398a1cf-6ff7-4670-b26b-43652ed253c8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:24.252674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6398a1cf-6ff7-4670-b26b-43652ed253c8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:24.253118 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6398a1cf-6ff7-4670-b26b-43652ed253c8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:24.253877 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6398a1cf-6ff7-4670-b26b-43652ed253c8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:24.254591 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6398a1cf-6ff7-4670-b26b-43652ed253c8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:24.388267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6398a1cf-6ff7-4670-b26b-43652ed253c8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:24.395695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6398a1cf-6ff7-4670-b26b-43652ed253c8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1517 microversion: 2.1 time: 0.154615 Jun 15 10:21:24.396253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 501/983] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:24 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:24.488348 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-12ad1060-b3a8-4e28-a9b4-fb097c5b8b6e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:24.488960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-12ad1060-b3a8-4e28-a9b4-fb097c5b8b6e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:24.494982 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12ad1060-b3a8-4e28-a9b4-fb097c5b8b6e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:24.495433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12ad1060-b3a8-4e28-a9b4-fb097c5b8b6e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:24.496191 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12ad1060-b3a8-4e28-a9b4-fb097c5b8b6e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:24.496631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12ad1060-b3a8-4e28-a9b4-fb097c5b8b6e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:24.631132 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-12ad1060-b3a8-4e28-a9b4-fb097c5b8b6e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:24.639060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-12ad1060-b3a8-4e28-a9b4-fb097c5b8b6e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.154506 Jun 15 10:21:24.639564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 483/984] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:24 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:25.058609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ba3720b4-d3f1-40f6-be41-7c6fcefc1c05 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:25.059777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ba3720b4-d3f1-40f6-be41-7c6fcefc1c05 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:25.066694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba3720b4-d3f1-40f6-be41-7c6fcefc1c05 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:25.067145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba3720b4-d3f1-40f6-be41-7c6fcefc1c05 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:25.067903 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba3720b4-d3f1-40f6-be41-7c6fcefc1c05 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:25.068365 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ba3720b4-d3f1-40f6-be41-7c6fcefc1c05 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:25.212514 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ba3720b4-d3f1-40f6-be41-7c6fcefc1c05 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:25.221040 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ba3720b4-d3f1-40f6-be41-7c6fcefc1c05 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.166139 Jun 15 10:21:25.221604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 502/985] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:25 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:25.236994 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e33d5439-8ab9-48c3-8162-886a8dc3348a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:25.237602 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e33d5439-8ab9-48c3-8162-886a8dc3348a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:25.244009 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e33d5439-8ab9-48c3-8162-886a8dc3348a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:25.244456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e33d5439-8ab9-48c3-8162-886a8dc3348a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:25.245218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e33d5439-8ab9-48c3-8162-886a8dc3348a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:25.245651 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e33d5439-8ab9-48c3-8162-886a8dc3348a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:25.382329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e33d5439-8ab9-48c3-8162-886a8dc3348a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:25.390220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e33d5439-8ab9-48c3-8162-886a8dc3348a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1575 microversion: 2.1 time: 0.157086 Jun 15 10:21:25.390818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 484/986] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:25 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:25.413733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-703cc82d-a0f4-4fa9-bb29-d5c9f55f2aa3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:25.414384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-703cc82d-a0f4-4fa9-bb29-d5c9f55f2aa3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:25.421135 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-703cc82d-a0f4-4fa9-bb29-d5c9f55f2aa3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:25.421590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-703cc82d-a0f4-4fa9-bb29-d5c9f55f2aa3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:25.422510 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-703cc82d-a0f4-4fa9-bb29-d5c9f55f2aa3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:25.422956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-703cc82d-a0f4-4fa9-bb29-d5c9f55f2aa3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:25.552049 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-703cc82d-a0f4-4fa9-bb29-d5c9f55f2aa3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:25.560064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-703cc82d-a0f4-4fa9-bb29-d5c9f55f2aa3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1517 microversion: 2.1 time: 0.149503 Jun 15 10:21:25.560634 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 503/987] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:25 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:25.657619 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4d71454f-f787-4bbd-970d-5d990c5263c5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:25.658236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4d71454f-f787-4bbd-970d-5d990c5263c5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:25.664077 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d71454f-f787-4bbd-970d-5d990c5263c5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:25.664515 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d71454f-f787-4bbd-970d-5d990c5263c5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:25.665263 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d71454f-f787-4bbd-970d-5d990c5263c5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:25.665691 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4d71454f-f787-4bbd-970d-5d990c5263c5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:25.800605 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4d71454f-f787-4bbd-970d-5d990c5263c5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:25.808436 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4d71454f-f787-4bbd-970d-5d990c5263c5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.155532 Jun 15 10:21:25.809050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 485/988] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:25 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:26.237907 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2826c40b-15fc-40d9-9f3c-be8d3cec2af8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:26.238555 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2826c40b-15fc-40d9-9f3c-be8d3cec2af8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:26.245234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2826c40b-15fc-40d9-9f3c-be8d3cec2af8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:26.245690 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2826c40b-15fc-40d9-9f3c-be8d3cec2af8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:26.246500 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2826c40b-15fc-40d9-9f3c-be8d3cec2af8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:26.246946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2826c40b-15fc-40d9-9f3c-be8d3cec2af8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:26.386708 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2826c40b-15fc-40d9-9f3c-be8d3cec2af8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:26.394952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2826c40b-15fc-40d9-9f3c-be8d3cec2af8 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.160979 Jun 15 10:21:26.395512 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 504/989] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:26 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:26.409757 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1d813d4f-7ce6-47a2-9848-2078fb7c326b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:26.410400 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1d813d4f-7ce6-47a2-9848-2078fb7c326b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:26.416717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1d813d4f-7ce6-47a2-9848-2078fb7c326b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:26.417162 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1d813d4f-7ce6-47a2-9848-2078fb7c326b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:26.417917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1d813d4f-7ce6-47a2-9848-2078fb7c326b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:26.418377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1d813d4f-7ce6-47a2-9848-2078fb7c326b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:26.550182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1d813d4f-7ce6-47a2-9848-2078fb7c326b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:26.557676 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1d813d4f-7ce6-47a2-9848-2078fb7c326b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1575 microversion: 2.1 time: 0.151722 Jun 15 10:21:26.558251 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 486/990] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:26 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:26.577385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-47ee19ce-8924-47d2-b050-69f4b4477bdd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:26.577992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-47ee19ce-8924-47d2-b050-69f4b4477bdd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:26.583933 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47ee19ce-8924-47d2-b050-69f4b4477bdd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:26.584380 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47ee19ce-8924-47d2-b050-69f4b4477bdd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:26.585137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47ee19ce-8924-47d2-b050-69f4b4477bdd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:26.585570 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47ee19ce-8924-47d2-b050-69f4b4477bdd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:26.806406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-47ee19ce-8924-47d2-b050-69f4b4477bdd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:26.815592 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-47ee19ce-8924-47d2-b050-69f4b4477bdd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.242583 Jun 15 10:21:26.821059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 505/991] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:26 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:26.844568 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f6c157d0-bbb5-4443-8ee6-74b8b53bc89e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:26.845177 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f6c157d0-bbb5-4443-8ee6-74b8b53bc89e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:26.851584 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6c157d0-bbb5-4443-8ee6-74b8b53bc89e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:26.852137 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6c157d0-bbb5-4443-8ee6-74b8b53bc89e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:26.852981 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6c157d0-bbb5-4443-8ee6-74b8b53bc89e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:26.853427 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f6c157d0-bbb5-4443-8ee6-74b8b53bc89e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:27.045297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f6c157d0-bbb5-4443-8ee6-74b8b53bc89e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:27.056338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f6c157d0-bbb5-4443-8ee6-74b8b53bc89e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.215281 Jun 15 10:21:27.057256 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 487/992] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:26 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:27.412606 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-edf17059-df26-46a4-81e1-b64bdc349c8d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:27.413262 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-edf17059-df26-46a4-81e1-b64bdc349c8d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:27.419921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edf17059-df26-46a4-81e1-b64bdc349c8d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:27.420376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edf17059-df26-46a4-81e1-b64bdc349c8d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:27.421184 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edf17059-df26-46a4-81e1-b64bdc349c8d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:27.421631 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-edf17059-df26-46a4-81e1-b64bdc349c8d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:27.505656 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-714ab773-69cf-4867-af33-234ea13ff311 req-64375937-e60b-451e-af2b-bca6befb1876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2b6202-44f6-40f9-849b-5803d6bc4804", "name": "network-vif-deleted", "tag": "50a683de-f892-4296-bd13-128af91a8b71"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:27.515499 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-714ab773-69cf-4867-af33-234ea13ff311 req-64375937-e60b-451e-af2b-bca6befb1876 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:27.516172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-714ab773-69cf-4867-af33-234ea13ff311 req-64375937-e60b-451e-af2b-bca6befb1876 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:27.528330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-714ab773-69cf-4867-af33-234ea13ff311 req-64375937-e60b-451e-af2b-bca6befb1876 service nova] Creating event network-vif-deleted:50a683de-f892-4296-bd13-128af91a8b71 for instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 on hv-cinder-83028 Jun 15 10:21:27.533905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-714ab773-69cf-4867-af33-234ea13ff311 req-64375937-e60b-451e-af2b-bca6befb1876 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032421 Jun 15 10:21:27.535068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 488/993] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:27.579442 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-76c90729-173d-46f8-b84b-4f81731b25b1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:27.580166 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-76c90729-173d-46f8-b84b-4f81731b25b1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:27.587467 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-76c90729-173d-46f8-b84b-4f81731b25b1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:27.587970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-76c90729-173d-46f8-b84b-4f81731b25b1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:27.588673 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-76c90729-173d-46f8-b84b-4f81731b25b1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:27.589188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-76c90729-173d-46f8-b84b-4f81731b25b1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:27.599284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-edf17059-df26-46a4-81e1-b64bdc349c8d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:27.615446 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-edf17059-df26-46a4-81e1-b64bdc349c8d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.206738 Jun 15 10:21:27.617488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 506/994] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:27 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:27.679022 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-76c90729-173d-46f8-b84b-4f81731b25b1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:27.688802 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-76c90729-173d-46f8-b84b-4f81731b25b1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1508 microversion: 2.1 time: 0.117094 Jun 15 10:21:27.689742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 489/995] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:27 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1508 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:27.936490 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f23ca645-112e-4d7e-8ead-cae7ace7c79b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:27.937107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f23ca645-112e-4d7e-8ead-cae7ace7c79b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:27.943183 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f23ca645-112e-4d7e-8ead-cae7ace7c79b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:27.943639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f23ca645-112e-4d7e-8ead-cae7ace7c79b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:27.944407 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f23ca645-112e-4d7e-8ead-cae7ace7c79b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:27.944844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f23ca645-112e-4d7e-8ead-cae7ace7c79b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:28.075424 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f53dff1c-1d7f-43e7-b545-4105b37fd734 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:28.076043 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f53dff1c-1d7f-43e7-b545-4105b37fd734 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:28.079039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f23ca645-112e-4d7e-8ead-cae7ace7c79b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:28.082523 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f53dff1c-1d7f-43e7-b545-4105b37fd734 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:28.082976 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f53dff1c-1d7f-43e7-b545-4105b37fd734 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:28.083752 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f53dff1c-1d7f-43e7-b545-4105b37fd734 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:28.084186 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f53dff1c-1d7f-43e7-b545-4105b37fd734 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:28.087664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f23ca645-112e-4d7e-8ead-cae7ace7c79b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.257526 Jun 15 10:21:28.088273 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 507/996] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:27 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:28.219923 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f53dff1c-1d7f-43e7-b545-4105b37fd734 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:28.228236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f53dff1c-1d7f-43e7-b545-4105b37fd734 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.157232 Jun 15 10:21:28.228870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 490/997] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:28 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:28.635085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-157f77bf-9e01-4d87-bdc4-ca6b4cf34433 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:28.635700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-157f77bf-9e01-4d87-bdc4-ca6b4cf34433 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:28.642775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-157f77bf-9e01-4d87-bdc4-ca6b4cf34433 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:28.643225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-157f77bf-9e01-4d87-bdc4-ca6b4cf34433 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:28.643983 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-157f77bf-9e01-4d87-bdc4-ca6b4cf34433 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:28.644415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-157f77bf-9e01-4d87-bdc4-ca6b4cf34433 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:28.705763 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3f162118-0136-4550-be1a-e007b0b8d01a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:28.706408 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3f162118-0136-4550-be1a-e007b0b8d01a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:28.713914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f162118-0136-4550-be1a-e007b0b8d01a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:28.714411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f162118-0136-4550-be1a-e007b0b8d01a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:28.715248 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f162118-0136-4550-be1a-e007b0b8d01a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:28.715865 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f162118-0136-4550-be1a-e007b0b8d01a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:28.796604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3f162118-0136-4550-be1a-e007b0b8d01a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:28.804283 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3f162118-0136-4550-be1a-e007b0b8d01a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 200 len: 1225 microversion: 2.1 time: 0.102309 Jun 15 10:21:28.805144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 491/998] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:28 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:28.835896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-157f77bf-9e01-4d87-bdc4-ca6b4cf34433 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:28.844897 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-157f77bf-9e01-4d87-bdc4-ca6b4cf34433 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.213617 Jun 15 10:21:28.845815 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 508/999] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:28 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:29.105547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-88a600cf-b173-4cb0-8bbc-c298161da227 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:29.106833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-88a600cf-b173-4cb0-8bbc-c298161da227 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:29.112821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88a600cf-b173-4cb0-8bbc-c298161da227 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:29.113265 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88a600cf-b173-4cb0-8bbc-c298161da227 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:29.114017 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88a600cf-b173-4cb0-8bbc-c298161da227 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:29.114475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88a600cf-b173-4cb0-8bbc-c298161da227 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:29.245127 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6940ff6e-3b3e-4411-ae76-7269aaa9cacb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:29.246018 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6940ff6e-3b3e-4411-ae76-7269aaa9cacb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:29.253176 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6940ff6e-3b3e-4411-ae76-7269aaa9cacb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:29.253763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6940ff6e-3b3e-4411-ae76-7269aaa9cacb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:29.254683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6940ff6e-3b3e-4411-ae76-7269aaa9cacb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:29.255228 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6940ff6e-3b3e-4411-ae76-7269aaa9cacb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:29.259920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-88a600cf-b173-4cb0-8bbc-c298161da227 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:29.270218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-88a600cf-b173-4cb0-8bbc-c298161da227 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.168399 Jun 15 10:21:29.270848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 492/1000] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:29 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:29.412332 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6940ff6e-3b3e-4411-ae76-7269aaa9cacb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:29.420372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6940ff6e-3b3e-4411-ae76-7269aaa9cacb tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.179350 Jun 15 10:21:29.420947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 509/1001] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:29 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:29.820902 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:29.821584 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:29.828877 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:29.829329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:29.830094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:29.830557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:29.844641 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] HTTP exception thrown: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Request method failure captured: Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 HTTP/1.1 Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbGiuwcgnz3wAPZXdYJtOedD4ae_NvXThHBveFffcWUmhQj8aGA9KkY8u47psBq0MODP2szIKlYPN6IvAcVoxpXybqrQHejffaprf1b3zSGI5F-sxSszwkvrTyD9AdjQI9iWg-d05BoZgEZqQ159KdqRA4xpFLAq3nF2TWlAw3IGM8k Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:21:29.846560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c6cf56db2b454c688b9305ef587f407e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestVolumeBootPattern-680872277 Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 9ee3b5927ffa4ef5b7f617073e083a80 Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:21:29.848203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '7f2b6202-44f6-40f9-849b-5803d6bc4804'} Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:21:29.849142 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:21:29.850748 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:29.852123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Returning 404 to user: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:21:29.852123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f2f573f3-2bbe-4fd6-94fd-a962043001ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jun 15 10:21:29.852123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 493/1002] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:29 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:21:29.864365 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d91ae246-74f3-4373-8daf-97ce107b53cd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:29.864984 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d91ae246-74f3-4373-8daf-97ce107b53cd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:29.871528 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d91ae246-74f3-4373-8daf-97ce107b53cd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:29.871955 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d91ae246-74f3-4373-8daf-97ce107b53cd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:29.872727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d91ae246-74f3-4373-8daf-97ce107b53cd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:29.873172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d91ae246-74f3-4373-8daf-97ce107b53cd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:29.950133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1155227565", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-552614952", "security_groups": [{"name": "tempest-secgroup-smoke-132408903"}], "block_device_mapping_v2": [{"uuid": "1642aa75-3ff7-4ddf-83fc-b9826b0c80a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82fdb04b-f19e-4e9e-88bc-bf5a50bb7342"}]}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:30.020961 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d91ae246-74f3-4373-8daf-97ce107b53cd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:30.030016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d91ae246-74f3-4373-8daf-97ce107b53cd tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.169427 Jun 15 10:21:30.031029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 510/1003] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:29 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:30.068477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.network.neutron [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] validate_networks() for [('82fdb04b-f19e-4e9e-88bc-bf5a50bb7342', None, None, None, None, None)] {{(pid=117721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:21:30.287683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a8c5f556-28a2-402a-8c51-b65d3d827dd3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:30.287683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a8c5f556-28a2-402a-8c51-b65d3d827dd3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:30.294157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8c5f556-28a2-402a-8c51-b65d3d827dd3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:30.294647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8c5f556-28a2-402a-8c51-b65d3d827dd3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:30.295418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8c5f556-28a2-402a-8c51-b65d3d827dd3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:30.295865 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a8c5f556-28a2-402a-8c51-b65d3d827dd3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:30.497636 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a8c5f556-28a2-402a-8c51-b65d3d827dd3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:30.505206 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a8c5f556-28a2-402a-8c51-b65d3d827dd3 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.222252 Jun 15 10:21:30.505775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 511/1004] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:30 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:30.510209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-448475d0-60fc-4462-877e-200dd2d2a9f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:30.510857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-448475d0-60fc-4462-877e-200dd2d2a9f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:30.517499 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-448475d0-60fc-4462-877e-200dd2d2a9f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:30.517946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-448475d0-60fc-4462-877e-200dd2d2a9f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:30.518748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-448475d0-60fc-4462-877e-200dd2d2a9f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:30.519180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-448475d0-60fc-4462-877e-200dd2d2a9f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:30.594099 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Flavor limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:21:30.594559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Image limits 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:21:30.595027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Flavor pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:21:30.595749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Image pref 0:0:0 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:21:30.596144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.virt.hardware [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:21:30.604762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:30.605204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:30.606727 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:30.607358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:30.625311 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Getting quotas for project c6cf56db2b454c688b9305ef587f407e. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:21:30.629577 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Getting quotas for user 9ee3b5927ffa4ef5b7f617073e083a80 and project c6cf56db2b454c688b9305ef587f407e. Resources: {'instances', 'cores', 'ram'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:21:30.663818 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-448475d0-60fc-4462-877e-200dd2d2a9f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:30.671963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-448475d0-60fc-4462-877e-200dd2d2a9f0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.165235 Jun 15 10:21:30.672544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 512/1005] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:30 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:30.686539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Going to run 1 instances... {{(pid=117721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:21:30.688622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1642aa75-3ff7-4ddf-83fc-b9826b0c80a6',volume_size=None,volume_type=None)] {{(pid=117721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:21:30.814394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0ff80e8a-f701-4ef9-99b3-bd5c8d765155 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.868387 Jun 15 10:21:30.815232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 494/1006] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:21:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:21:30.827584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-46461ac6-4f47-41a5-a95d-c761938f63b2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:30.828629 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-46461ac6-4f47-41a5-a95d-c761938f63b2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:30.883189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-46461ac6-4f47-41a5-a95d-c761938f63b2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:30.890863 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-46461ac6-4f47-41a5-a95d-c761938f63b2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1094 microversion: 2.1 time: 0.069282 Jun 15 10:21:30.891472 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 513/1007] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:30 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:31.054016 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dc6c68c1-8025-4eee-a7a8-e03ed7b35329 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:31.054647 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dc6c68c1-8025-4eee-a7a8-e03ed7b35329 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:31.061967 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dc6c68c1-8025-4eee-a7a8-e03ed7b35329 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:31.062501 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dc6c68c1-8025-4eee-a7a8-e03ed7b35329 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:31.063219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dc6c68c1-8025-4eee-a7a8-e03ed7b35329 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:31.063856 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dc6c68c1-8025-4eee-a7a8-e03ed7b35329 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:31.223750 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dc6c68c1-8025-4eee-a7a8-e03ed7b35329 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:31.233842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dc6c68c1-8025-4eee-a7a8-e03ed7b35329 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.184357 Jun 15 10:21:31.234443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 495/1008] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:31 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:31.522350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8842950e-da82-4ba8-a056-7b982fc0b207 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:31.522885 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8842950e-da82-4ba8-a056-7b982fc0b207 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:31.529560 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8842950e-da82-4ba8-a056-7b982fc0b207 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:31.530115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8842950e-da82-4ba8-a056-7b982fc0b207 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:31.530917 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8842950e-da82-4ba8-a056-7b982fc0b207 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:31.531362 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8842950e-da82-4ba8-a056-7b982fc0b207 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:31.667870 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8842950e-da82-4ba8-a056-7b982fc0b207 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:31.671935 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:31.679845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8842950e-da82-4ba8-a056-7b982fc0b207 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.161517 Jun 15 10:21:31.680412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 514/1009] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:31 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:31.689358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-726fbdcb-c865-4f9c-a160-e0744fd57992 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:31.689983 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-726fbdcb-c865-4f9c-a160-e0744fd57992 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:31.695987 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-726fbdcb-c865-4f9c-a160-e0744fd57992 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:31.696438 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-726fbdcb-c865-4f9c-a160-e0744fd57992 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:31.697190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-726fbdcb-c865-4f9c-a160-e0744fd57992 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:31.697641 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-726fbdcb-c865-4f9c-a160-e0744fd57992 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:31.842834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-726fbdcb-c865-4f9c-a160-e0744fd57992 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:31.850710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-726fbdcb-c865-4f9c-a160-e0744fd57992 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1676 microversion: 2.1 time: 0.165633 Jun 15 10:21:31.851384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 496/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:31 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:31.909331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-43bfddc4-4039-493f-b134-4af4f1766ad7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:31.910578 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-43bfddc4-4039-493f-b134-4af4f1766ad7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:31.918325 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-43bfddc4-4039-493f-b134-4af4f1766ad7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:31.918850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-43bfddc4-4039-493f-b134-4af4f1766ad7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:31.920432 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-43bfddc4-4039-493f-b134-4af4f1766ad7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:31.920884 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-43bfddc4-4039-493f-b134-4af4f1766ad7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:31.995544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-43bfddc4-4039-493f-b134-4af4f1766ad7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:32.004205 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-43bfddc4-4039-493f-b134-4af4f1766ad7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1200 microversion: 2.1 time: 0.099498 Jun 15 10:21:32.005095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 515/1011] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:31 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:32.251116 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b62f4db8-97cc-45fe-9c6c-b2ec3d01b9a3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:32.252626 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b62f4db8-97cc-45fe-9c6c-b2ec3d01b9a3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:32.259518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b62f4db8-97cc-45fe-9c6c-b2ec3d01b9a3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.259969 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b62f4db8-97cc-45fe-9c6c-b2ec3d01b9a3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.260739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b62f4db8-97cc-45fe-9c6c-b2ec3d01b9a3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.261181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b62f4db8-97cc-45fe-9c6c-b2ec3d01b9a3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.431966 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b62f4db8-97cc-45fe-9c6c-b2ec3d01b9a3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:32.436036 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:32.442000 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b62f4db8-97cc-45fe-9c6c-b2ec3d01b9a3 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.195627 Jun 15 10:21:32.442604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 497/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:32 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:32.694943 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2f54498f-c4f5-4f99-9319-2c21683bf22a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:32.695640 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2f54498f-c4f5-4f99-9319-2c21683bf22a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:32.699415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9b0906b9-4f80-46a6-a701-0a8ce09b08e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:32.699750 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9b0906b9-4f80-46a6-a701-0a8ce09b08e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:32.702540 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f54498f-c4f5-4f99-9319-2c21683bf22a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.703281 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f54498f-c4f5-4f99-9319-2c21683bf22a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.704064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f54498f-c4f5-4f99-9319-2c21683bf22a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.704508 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2f54498f-c4f5-4f99-9319-2c21683bf22a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.706024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b0906b9-4f80-46a6-a701-0a8ce09b08e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.706514 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b0906b9-4f80-46a6-a701-0a8ce09b08e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.707293 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b0906b9-4f80-46a6-a701-0a8ce09b08e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.707740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b0906b9-4f80-46a6-a701-0a8ce09b08e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.799084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-2f54498f-c4f5-4f99-9319-2c21683bf22a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lazy-loading 'services' on Instance uuid 297abce4-955d-4411-8d84-3b14a31c5f19 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:21:32.881629 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9b0906b9-4f80-46a6-a701-0a8ce09b08e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:32.896920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9b0906b9-4f80-46a6-a701-0a8ce09b08e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.201598 Jun 15 10:21:32.898704 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2f54498f-c4f5-4f99-9319-2c21683bf22a tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "DELETE /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments/50d9f8e0-4615-4d4f-8f6c-ad3877b64b12" status: 202 len: 0 microversion: 2.1 time: 0.208318 Jun 15 10:21:32.899478 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 516/1013] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:21:32 2022] DELETE /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments/50d9f8e0-4615-4d4f-8f6c-ad3877b64b12 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:21:32.906159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e6244732-3fc5-4ec8-8c03-fce74e13c59f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:32.906992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e6244732-3fc5-4ec8-8c03-fce74e13c59f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:32.914118 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6244732-3fc5-4ec8-8c03-fce74e13c59f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.915469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6244732-3fc5-4ec8-8c03-fce74e13c59f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.916791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6244732-3fc5-4ec8-8c03-fce74e13c59f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.917251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e6244732-3fc5-4ec8-8c03-fce74e13c59f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.920295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 498/1014] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:32 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:32.925394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-062e6c7b-e86d-4f8b-9235-66ea88a5e3d6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:32.932416 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-062e6c7b-e86d-4f8b-9235-66ea88a5e3d6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:32.942108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-062e6c7b-e86d-4f8b-9235-66ea88a5e3d6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.942643 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-062e6c7b-e86d-4f8b-9235-66ea88a5e3d6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:32.943523 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-062e6c7b-e86d-4f8b-9235-66ea88a5e3d6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:32.944037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-062e6c7b-e86d-4f8b-9235-66ea88a5e3d6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.002095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-062e6c7b-e86d-4f8b-9235-66ea88a5e3d6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080610 Jun 15 10:21:33.002900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 499/1015] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:21:32 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:33.022445 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2cafd1ab-fb66-4d48-a93f-760ff767baed tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:33.023390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2cafd1ab-fb66-4d48-a93f-760ff767baed tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:33.034598 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2cafd1ab-fb66-4d48-a93f-760ff767baed tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.035051 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2cafd1ab-fb66-4d48-a93f-760ff767baed tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.035817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2cafd1ab-fb66-4d48-a93f-760ff767baed tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.036422 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2cafd1ab-fb66-4d48-a93f-760ff767baed tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.160664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e6244732-3fc5-4ec8-8c03-fce74e13c59f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:33.170204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e6244732-3fc5-4ec8-8c03-fce74e13c59f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1653 microversion: 2.1 time: 0.269465 Jun 15 10:21:33.171458 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 517/1016] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:32 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1653 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:33.187627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5acdc122-3774-4c5a-b884-d5bd36dc71e9 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:33.193761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5acdc122-3774-4c5a-b884-d5bd36dc71e9 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.194064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5acdc122-3774-4c5a-b884-d5bd36dc71e9 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.220008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5acdc122-3774-4c5a-b884-d5bd36dc71e9 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Going to try to start instance {{(pid=117720) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 10:21:33.230223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-2cafd1ab-fb66-4d48-a93f-760ff767baed tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:33.239075 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2cafd1ab-fb66-4d48-a93f-760ff767baed tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1277 microversion: 2.1 time: 0.220683 Jun 15 10:21:33.239662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 500/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:33 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:33.268414 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5acdc122-3774-4c5a-b884-d5bd36dc71e9 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/action" status: 202 len: 0 microversion: 2.1 time: 0.085227 Jun 15 10:21:33.269223 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 518/1018] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:21:33 2022] POST /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:21:33.278690 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6901bb01-0c84-4b6d-827d-15934dff2368 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:33.279481 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6901bb01-0c84-4b6d-827d-15934dff2368 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:33.286179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6901bb01-0c84-4b6d-827d-15934dff2368 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.286680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6901bb01-0c84-4b6d-827d-15934dff2368 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.287459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6901bb01-0c84-4b6d-827d-15934dff2368 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.288108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6901bb01-0c84-4b6d-827d-15934dff2368 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.427067 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6901bb01-0c84-4b6d-827d-15934dff2368 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:33.435229 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6901bb01-0c84-4b6d-827d-15934dff2368 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1662 microversion: 2.1 time: 0.160454 Jun 15 10:21:33.435826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 501/1019] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:33 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:33.459981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-defb0a1a-9190-4981-b0c4-1e78ed248689 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:33.460695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-defb0a1a-9190-4981-b0c4-1e78ed248689 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:33.467813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-defb0a1a-9190-4981-b0c4-1e78ed248689 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.468290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-defb0a1a-9190-4981-b0c4-1e78ed248689 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.469046 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-defb0a1a-9190-4981-b0c4-1e78ed248689 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.469486 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-defb0a1a-9190-4981-b0c4-1e78ed248689 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.631777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-defb0a1a-9190-4981-b0c4-1e78ed248689 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:33.640035 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-defb0a1a-9190-4981-b0c4-1e78ed248689 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.184699 Jun 15 10:21:33.641013 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 519/1020] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:33 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:33.754339 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-91e67938-9272-4dc5-b6e2-eb7a157659fe req-c67e4c1a-b9a3-47d7-9836-e6a0144257d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3108892e-7e39-4745-9fe8-def8a153e577", "tag": "2351e726-d5be-48b8-b869-58a22c8cf327"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:33.771056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-91e67938-9272-4dc5-b6e2-eb7a157659fe req-c67e4c1a-b9a3-47d7-9836-e6a0144257d9 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.771506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-91e67938-9272-4dc5-b6e2-eb7a157659fe req-c67e4c1a-b9a3-47d7-9836-e6a0144257d9 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.793124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-91e67938-9272-4dc5-b6e2-eb7a157659fe req-c67e4c1a-b9a3-47d7-9836-e6a0144257d9 service nova] Creating event network-changed:2351e726-d5be-48b8-b869-58a22c8cf327 for instance 3108892e-7e39-4745-9fe8-def8a153e577 on hv-cinder-83028 Jun 15 10:21:33.799754 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-91e67938-9272-4dc5-b6e2-eb7a157659fe req-c67e4c1a-b9a3-47d7-9836-e6a0144257d9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049059 Jun 15 10:21:33.800377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 502/1021] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:33.922843 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-43477178-c5fd-4fd0-a1e4-735b66228d67 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:33.923465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-43477178-c5fd-4fd0-a1e4-735b66228d67 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:33.930044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-43477178-c5fd-4fd0-a1e4-735b66228d67 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.930530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-43477178-c5fd-4fd0-a1e4-735b66228d67 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:33.931297 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-43477178-c5fd-4fd0-a1e4-735b66228d67 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:33.931739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-43477178-c5fd-4fd0-a1e4-735b66228d67 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.013806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c24be4e2-b2a0-42e1-9685-1d4775b85f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:34.014846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c24be4e2-b2a0-42e1-9685-1d4775b85f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:34.021139 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c24be4e2-b2a0-42e1-9685-1d4775b85f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:34.021519 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c24be4e2-b2a0-42e1-9685-1d4775b85f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.022299 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c24be4e2-b2a0-42e1-9685-1d4775b85f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:34.022727 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c24be4e2-b2a0-42e1-9685-1d4775b85f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.052834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c24be4e2-b2a0-42e1-9685-1d4775b85f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Jun 15 10:21:34.053399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 503/1022] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:21:34 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:21:34.067095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-43477178-c5fd-4fd0-a1e4-735b66228d67 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:34.074476 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-43477178-c5fd-4fd0-a1e4-735b66228d67 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.156391 Jun 15 10:21:34.075039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 520/1023] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:33 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:34.256846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7a29c3aa-5dc8-4045-a07b-db4ec7f39a01 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:34.257384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7a29c3aa-5dc8-4045-a07b-db4ec7f39a01 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:34.264196 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a29c3aa-5dc8-4045-a07b-db4ec7f39a01 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:34.264641 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a29c3aa-5dc8-4045-a07b-db4ec7f39a01 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.265392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a29c3aa-5dc8-4045-a07b-db4ec7f39a01 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:34.265828 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7a29c3aa-5dc8-4045-a07b-db4ec7f39a01 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.394756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7a29c3aa-5dc8-4045-a07b-db4ec7f39a01 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:34.402041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7a29c3aa-5dc8-4045-a07b-db4ec7f39a01 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.149068 Jun 15 10:21:34.402627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 504/1024] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:34 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:34.452528 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-47a2a73c-fdd6-446b-b012-10bbc14cda71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:34.453151 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-47a2a73c-fdd6-446b-b012-10bbc14cda71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:34.459278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47a2a73c-fdd6-446b-b012-10bbc14cda71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:34.459741 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47a2a73c-fdd6-446b-b012-10bbc14cda71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.460512 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47a2a73c-fdd6-446b-b012-10bbc14cda71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:34.460960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47a2a73c-fdd6-446b-b012-10bbc14cda71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.598251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-47a2a73c-fdd6-446b-b012-10bbc14cda71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:34.605670 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-47a2a73c-fdd6-446b-b012-10bbc14cda71 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1662 microversion: 2.1 time: 0.157554 Jun 15 10:21:34.606228 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 521/1025] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:34 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:34.656940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c861194f-8188-413b-b8b1-d25913d59eb0 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:34.657586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c861194f-8188-413b-b8b1-d25913d59eb0 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:34.663627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c861194f-8188-413b-b8b1-d25913d59eb0 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:34.664085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c861194f-8188-413b-b8b1-d25913d59eb0 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.664850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c861194f-8188-413b-b8b1-d25913d59eb0 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:34.665294 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c861194f-8188-413b-b8b1-d25913d59eb0 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:34.805370 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c861194f-8188-413b-b8b1-d25913d59eb0 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:34.813820 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c861194f-8188-413b-b8b1-d25913d59eb0 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.160933 Jun 15 10:21:34.814426 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 505/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:34 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:35.064665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8a87c98b-dbcd-4582-8afb-6192a84db7f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:35.065587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8a87c98b-dbcd-4582-8afb-6192a84db7f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:35.072025 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a87c98b-dbcd-4582-8afb-6192a84db7f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.072473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a87c98b-dbcd-4582-8afb-6192a84db7f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.073230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a87c98b-dbcd-4582-8afb-6192a84db7f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.073668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a87c98b-dbcd-4582-8afb-6192a84db7f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.091681 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5ca5cf9a-b9d5-44a9-a952-bd1527489076 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:35.092298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5ca5cf9a-b9d5-44a9-a952-bd1527489076 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:35.098589 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ca5cf9a-b9d5-44a9-a952-bd1527489076 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.099030 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ca5cf9a-b9d5-44a9-a952-bd1527489076 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.099808 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ca5cf9a-b9d5-44a9-a952-bd1527489076 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.100253 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5ca5cf9a-b9d5-44a9-a952-bd1527489076 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.102687 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8a87c98b-dbcd-4582-8afb-6192a84db7f6 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042679 Jun 15 10:21:35.107779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 522/1027] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:21:35 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:35.277458 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5ca5cf9a-b9d5-44a9-a952-bd1527489076 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:35.286606 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5ca5cf9a-b9d5-44a9-a952-bd1527489076 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.198733 Jun 15 10:21:35.287204 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 506/1028] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:35 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:35.419485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d590314e-b944-45dd-a898-61c22eb0c38e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:35.420301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d590314e-b944-45dd-a898-61c22eb0c38e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:35.427775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d590314e-b944-45dd-a898-61c22eb0c38e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.428241 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d590314e-b944-45dd-a898-61c22eb0c38e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.429030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d590314e-b944-45dd-a898-61c22eb0c38e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.429478 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d590314e-b944-45dd-a898-61c22eb0c38e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.627763 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-53fa6431-ee67-449a-b2f5-1fef02ff025e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:35.629071 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-53fa6431-ee67-449a-b2f5-1fef02ff025e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:35.639563 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d590314e-b944-45dd-a898-61c22eb0c38e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:35.640920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-53fa6431-ee67-449a-b2f5-1fef02ff025e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.641375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-53fa6431-ee67-449a-b2f5-1fef02ff025e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.642491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-53fa6431-ee67-449a-b2f5-1fef02ff025e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.642941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-53fa6431-ee67-449a-b2f5-1fef02ff025e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.647278 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d590314e-b944-45dd-a898-61c22eb0c38e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.231759 Jun 15 10:21:35.648043 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 523/1029] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:35 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:35.832052 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e0fb5490-a5fd-480d-9fa2-fc5038d3b914 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:35.832993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e0fb5490-a5fd-480d-9fa2-fc5038d3b914 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:35.840364 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0fb5490-a5fd-480d-9fa2-fc5038d3b914 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.840817 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0fb5490-a5fd-480d-9fa2-fc5038d3b914 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.841683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0fb5490-a5fd-480d-9fa2-fc5038d3b914 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:35.842023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0fb5490-a5fd-480d-9fa2-fc5038d3b914 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:35.889541 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-53fa6431-ee67-449a-b2f5-1fef02ff025e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:35.897747 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-53fa6431-ee67-449a-b2f5-1fef02ff025e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1662 microversion: 2.1 time: 0.277743 Jun 15 10:21:35.898662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 507/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:35 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1662 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:36.041219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e0fb5490-a5fd-480d-9fa2-fc5038d3b914 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:36.050250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e0fb5490-a5fd-480d-9fa2-fc5038d3b914 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.222471 Jun 15 10:21:36.050838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 524/1031] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:35 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:36.123126 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e8585425-e514-4877-aa6e-b39975f0335e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:36.124228 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e8585425-e514-4877-aa6e-b39975f0335e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:36.130426 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8585425-e514-4877-aa6e-b39975f0335e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.130881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8585425-e514-4877-aa6e-b39975f0335e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.131657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8585425-e514-4877-aa6e-b39975f0335e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.132120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e8585425-e514-4877-aa6e-b39975f0335e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.162347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e8585425-e514-4877-aa6e-b39975f0335e tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046024 Jun 15 10:21:36.162936 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 508/1032] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:21:36 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:21:36.237787 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1e381f0d-a7ac-4c87-ac97-fc4f1208a226 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:36.239099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1e381f0d-a7ac-4c87-ac97-fc4f1208a226 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:36.245899 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1e381f0d-a7ac-4c87-ac97-fc4f1208a226 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.246375 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1e381f0d-a7ac-4c87-ac97-fc4f1208a226 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.247420 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1e381f0d-a7ac-4c87-ac97-fc4f1208a226 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.247920 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1e381f0d-a7ac-4c87-ac97-fc4f1208a226 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.275729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1e381f0d-a7ac-4c87-ac97-fc4f1208a226 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:21:36.304022 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-544f6162-b9dd-499f-a0f5-c21b6b718d41 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:36.304660 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-544f6162-b9dd-499f-a0f5-c21b6b718d41 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:36.312112 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-544f6162-b9dd-499f-a0f5-c21b6b718d41 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.312560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-544f6162-b9dd-499f-a0f5-c21b6b718d41 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.313335 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-544f6162-b9dd-499f-a0f5-c21b6b718d41 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.313766 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-544f6162-b9dd-499f-a0f5-c21b6b718d41 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.383353 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1e381f0d-a7ac-4c87-ac97-fc4f1208a226 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "DELETE /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 204 len: 0 microversion: 2.1 time: 0.150257 Jun 15 10:21:36.384522 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 525/1033] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:21:36 2022] DELETE /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:36.393006 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5888b24e-9197-4043-8a5c-8199783d0a1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:36.393865 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5888b24e-9197-4043-8a5c-8199783d0a1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:36.400335 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5888b24e-9197-4043-8a5c-8199783d0a1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.400782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5888b24e-9197-4043-8a5c-8199783d0a1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.401558 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5888b24e-9197-4043-8a5c-8199783d0a1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.401993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5888b24e-9197-4043-8a5c-8199783d0a1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.692529 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-544f6162-b9dd-499f-a0f5-c21b6b718d41 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:36.695345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5888b24e-9197-4043-8a5c-8199783d0a1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:36.700631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-544f6162-b9dd-499f-a0f5-c21b6b718d41 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.399885 Jun 15 10:21:36.701822 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 509/1034] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:36 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:36.703590 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5888b24e-9197-4043-8a5c-8199783d0a1f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1691 microversion: 2.1 time: 0.314792 Jun 15 10:21:36.704318 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 526/1035] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:36 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1691 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:36.706736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7787c663-e194-4a79-bd13-12b617ae3111 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:36.707577 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7787c663-e194-4a79-bd13-12b617ae3111 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:36.713857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7787c663-e194-4a79-bd13-12b617ae3111 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.714331 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7787c663-e194-4a79-bd13-12b617ae3111 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.715098 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7787c663-e194-4a79-bd13-12b617ae3111 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.715560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7787c663-e194-4a79-bd13-12b617ae3111 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.848651 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7787c663-e194-4a79-bd13-12b617ae3111 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:36.856054 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7787c663-e194-4a79-bd13-12b617ae3111 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.153168 Jun 15 10:21:36.857182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 510/1036] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:36 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:36.914845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dd0e8ddc-46b6-421d-a45e-58f407995ba0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:36.915455 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dd0e8ddc-46b6-421d-a45e-58f407995ba0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:36.921359 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd0e8ddc-46b6-421d-a45e-58f407995ba0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.921809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd0e8ddc-46b6-421d-a45e-58f407995ba0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:36.922605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd0e8ddc-46b6-421d-a45e-58f407995ba0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:36.923044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dd0e8ddc-46b6-421d-a45e-58f407995ba0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.053578 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dd0e8ddc-46b6-421d-a45e-58f407995ba0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:37.061681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dd0e8ddc-46b6-421d-a45e-58f407995ba0 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1662 microversion: 2.1 time: 0.150723 Jun 15 10:21:37.062287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 527/1037] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:36 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:37.068412 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a8653bee-f38e-4ae4-8eee-eef64d19f412 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:37.069018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a8653bee-f38e-4ae4-8eee-eef64d19f412 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:37.075680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8653bee-f38e-4ae4-8eee-eef64d19f412 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:37.076127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8653bee-f38e-4ae4-8eee-eef64d19f412 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.076881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8653bee-f38e-4ae4-8eee-eef64d19f412 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:37.077316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a8653bee-f38e-4ae4-8eee-eef64d19f412 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.222140 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a8653bee-f38e-4ae4-8eee-eef64d19f412 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:37.230288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a8653bee-f38e-4ae4-8eee-eef64d19f412 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.165760 Jun 15 10:21:37.230917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 511/1038] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:37 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:37.720403 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-91807ac5-5bc4-4ddf-b7c3-77d01d3727e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:37.720949 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-91807ac5-5bc4-4ddf-b7c3-77d01d3727e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:37.721651 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-df561257-b0ec-4877-8fd8-502d4f093e6f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:37.722288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-df561257-b0ec-4877-8fd8-502d4f093e6f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:37.727415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-91807ac5-5bc4-4ddf-b7c3-77d01d3727e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:37.727873 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-91807ac5-5bc4-4ddf-b7c3-77d01d3727e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.728637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-91807ac5-5bc4-4ddf-b7c3-77d01d3727e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:37.728740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df561257-b0ec-4877-8fd8-502d4f093e6f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:37.729082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-91807ac5-5bc4-4ddf-b7c3-77d01d3727e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.729205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df561257-b0ec-4877-8fd8-502d4f093e6f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.729916 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df561257-b0ec-4877-8fd8-502d4f093e6f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:37.730384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-df561257-b0ec-4877-8fd8-502d4f093e6f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.734675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:37.932007 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-91807ac5-5bc4-4ddf-b7c3-77d01d3727e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:37.935944 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-df561257-b0ec-4877-8fd8-502d4f093e6f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:37.940693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-91807ac5-5bc4-4ddf-b7c3-77d01d3727e0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.225926 Jun 15 10:21:37.942433 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 528/1039] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:37 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:37.945519 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-df561257-b0ec-4877-8fd8-502d4f093e6f tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1691 microversion: 2.1 time: 0.228075 Jun 15 10:21:37.945845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-89126a53-7102-4e04-9654-2ba3f9427c53 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:37.955493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-89126a53-7102-4e04-9654-2ba3f9427c53 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:37.955493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89126a53-7102-4e04-9654-2ba3f9427c53 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:37.955493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89126a53-7102-4e04-9654-2ba3f9427c53 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.955493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89126a53-7102-4e04-9654-2ba3f9427c53 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:37.955946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89126a53-7102-4e04-9654-2ba3f9427c53 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:37.956293 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 512/1040] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:37 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1691 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:38.079724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e1977b4c-77ef-4057-9bf2-1e4f1af8db10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:38.080330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e1977b4c-77ef-4057-9bf2-1e4f1af8db10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:38.086118 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-89126a53-7102-4e04-9654-2ba3f9427c53 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:38.086395 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e1977b4c-77ef-4057-9bf2-1e4f1af8db10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:38.086845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e1977b4c-77ef-4057-9bf2-1e4f1af8db10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:38.087616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e1977b4c-77ef-4057-9bf2-1e4f1af8db10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:38.088054 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e1977b4c-77ef-4057-9bf2-1e4f1af8db10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:38.096789 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-89126a53-7102-4e04-9654-2ba3f9427c53 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.154504 Jun 15 10:21:38.097721 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 529/1041] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:37 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:38.224097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e1977b4c-77ef-4057-9bf2-1e4f1af8db10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:38.232040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e1977b4c-77ef-4057-9bf2-1e4f1af8db10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1662 microversion: 2.1 time: 0.156926 Jun 15 10:21:38.232609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 513/1042] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:38 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:38.247637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6468d9ac-81ec-4de5-9f01-df5d9b96228d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:38.248263 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6468d9ac-81ec-4de5-9f01-df5d9b96228d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:38.254216 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6468d9ac-81ec-4de5-9f01-df5d9b96228d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:38.254846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6468d9ac-81ec-4de5-9f01-df5d9b96228d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:38.255619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6468d9ac-81ec-4de5-9f01-df5d9b96228d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:38.256059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6468d9ac-81ec-4de5-9f01-df5d9b96228d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:38.399162 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6468d9ac-81ec-4de5-9f01-df5d9b96228d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:38.407206 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6468d9ac-81ec-4de5-9f01-df5d9b96228d tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.163716 Jun 15 10:21:38.407780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 530/1043] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:38 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:38.958095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6a39d992-ad7d-4896-a64a-9f61c937f1a2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:38.958584 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6a39d992-ad7d-4896-a64a-9f61c937f1a2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:38.963479 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-14be882f-4810-47ba-94be-363b64b7ada7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:38.964164 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-14be882f-4810-47ba-94be-363b64b7ada7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:38.965904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a39d992-ad7d-4896-a64a-9f61c937f1a2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:38.966776 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a39d992-ad7d-4896-a64a-9f61c937f1a2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:38.967983 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a39d992-ad7d-4896-a64a-9f61c937f1a2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:38.968147 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6a39d992-ad7d-4896-a64a-9f61c937f1a2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:38.971236 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-14be882f-4810-47ba-94be-363b64b7ada7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:38.971692 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-14be882f-4810-47ba-94be-363b64b7ada7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:38.972449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-14be882f-4810-47ba-94be-363b64b7ada7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:38.972883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-14be882f-4810-47ba-94be-363b64b7ada7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:39.164496 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6a39d992-ad7d-4896-a64a-9f61c937f1a2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:39.169115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-14be882f-4810-47ba-94be-363b64b7ada7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:39.172705 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6a39d992-ad7d-4896-a64a-9f61c937f1a2 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.218735 Jun 15 10:21:39.173282 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 514/1044] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:38 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:39.176805 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-14be882f-4810-47ba-94be-363b64b7ada7 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1691 microversion: 2.1 time: 0.217402 Jun 15 10:21:39.177674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 531/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:38 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1691 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:39.178031 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1288405f-8812-4650-a0a5-17b9b6b6015f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:39.178621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1288405f-8812-4650-a0a5-17b9b6b6015f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:39.180446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:39.185776 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1288405f-8812-4650-a0a5-17b9b6b6015f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:39.186219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1288405f-8812-4650-a0a5-17b9b6b6015f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:39.187007 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1288405f-8812-4650-a0a5-17b9b6b6015f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:39.187439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1288405f-8812-4650-a0a5-17b9b6b6015f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:39.192621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:39.249346 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0cb081bc-ffff-44ac-8d13-690c70c73642 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:39.250067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0cb081bc-ffff-44ac-8d13-690c70c73642 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:39.256109 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0cb081bc-ffff-44ac-8d13-690c70c73642 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:39.256572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0cb081bc-ffff-44ac-8d13-690c70c73642 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:39.257343 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0cb081bc-ffff-44ac-8d13-690c70c73642 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:39.257790 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0cb081bc-ffff-44ac-8d13-690c70c73642 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:39.355621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1288405f-8812-4650-a0a5-17b9b6b6015f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:39.364267 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1288405f-8812-4650-a0a5-17b9b6b6015f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.189833 Jun 15 10:21:39.365060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 515/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:39 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:39.414883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0cb081bc-ffff-44ac-8d13-690c70c73642 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:39.423744 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0cb081bc-ffff-44ac-8d13-690c70c73642 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1662 microversion: 2.1 time: 0.178433 Jun 15 10:21:39.424883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cf17721d-99a8-4a4e-b276-990b17e17242 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:39.425042 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 532/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:39 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:39.425429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cf17721d-99a8-4a4e-b276-990b17e17242 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:39.431425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf17721d-99a8-4a4e-b276-990b17e17242 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:39.431877 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf17721d-99a8-4a4e-b276-990b17e17242 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:39.432649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf17721d-99a8-4a4e-b276-990b17e17242 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:39.433087 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf17721d-99a8-4a4e-b276-990b17e17242 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:39.471908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-4859cb37-3f08-460b-8114-5dc531f3c9b2 req-12ebb524-6f6c-4a7b-b91c-c9ab96838bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017fbaea-de4e-4981-b1a7-f85fc6d5fc74", "name": "network-vif-plugged", "status": "completed", "tag": "a0d42ef5-c08b-4c5d-807e-fde0e4998fd2"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:39.481666 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4859cb37-3f08-460b-8114-5dc531f3c9b2 req-12ebb524-6f6c-4a7b-b91c-c9ab96838bfb service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:39.482507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-4859cb37-3f08-460b-8114-5dc531f3c9b2 req-12ebb524-6f6c-4a7b-b91c-c9ab96838bfb service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:39.496857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-4859cb37-3f08-460b-8114-5dc531f3c9b2 req-12ebb524-6f6c-4a7b-b91c-c9ab96838bfb service nova] Creating event network-vif-plugged:a0d42ef5-c08b-4c5d-807e-fde0e4998fd2 for instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 on hv-cinder-83028 Jun 15 10:21:39.502575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-4859cb37-3f08-460b-8114-5dc531f3c9b2 req-12ebb524-6f6c-4a7b-b91c-c9ab96838bfb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034407 Jun 15 10:21:39.503117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 533/1048] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:39.587052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cf17721d-99a8-4a4e-b276-990b17e17242 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:39.599573 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cf17721d-99a8-4a4e-b276-990b17e17242 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.178476 Jun 15 10:21:39.600152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 516/1049] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:39 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:40.192468 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-93c30b31-67c5-4eb5-a33b-c8786ecdd8a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:40.193103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-93c30b31-67c5-4eb5-a33b-c8786ecdd8a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:40.193390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-afe5dc19-6a2b-4007-a3cc-701b2b059f2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:40.194002 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-afe5dc19-6a2b-4007-a3cc-701b2b059f2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:40.195934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:40.201149 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afe5dc19-6a2b-4007-a3cc-701b2b059f2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.201582 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afe5dc19-6a2b-4007-a3cc-701b2b059f2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.202367 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afe5dc19-6a2b-4007-a3cc-701b2b059f2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.202867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afe5dc19-6a2b-4007-a3cc-701b2b059f2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.203674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93c30b31-67c5-4eb5-a33b-c8786ecdd8a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.204132 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93c30b31-67c5-4eb5-a33b-c8786ecdd8a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.204908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93c30b31-67c5-4eb5-a33b-c8786ecdd8a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.205352 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-93c30b31-67c5-4eb5-a33b-c8786ecdd8a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.397005 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-93c30b31-67c5-4eb5-a33b-c8786ecdd8a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:40.403628 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-afe5dc19-6a2b-4007-a3cc-701b2b059f2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:40.404893 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-93c30b31-67c5-4eb5-a33b-c8786ecdd8a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.217065 Jun 15 10:21:40.405479 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 534/1050] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:40 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:40.409888 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1afd6da8-9db1-40ba-8916-81ae13159b31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:40.410647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1afd6da8-9db1-40ba-8916-81ae13159b31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:40.416092 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-afe5dc19-6a2b-4007-a3cc-701b2b059f2d tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1691 microversion: 2.1 time: 0.226429 Jun 15 10:21:40.416236 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1afd6da8-9db1-40ba-8916-81ae13159b31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.416675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1afd6da8-9db1-40ba-8916-81ae13159b31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.416783 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 517/1051] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:40 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:40.417446 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1afd6da8-9db1-40ba-8916-81ae13159b31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.417895 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1afd6da8-9db1-40ba-8916-81ae13159b31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.441222 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9e7ecd3c-b91f-406d-9b4f-35b0c3637e50 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:40.441831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9e7ecd3c-b91f-406d-9b4f-35b0c3637e50 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:40.447734 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9e7ecd3c-b91f-406d-9b4f-35b0c3637e50 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.448114 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9e7ecd3c-b91f-406d-9b4f-35b0c3637e50 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.448882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9e7ecd3c-b91f-406d-9b4f-35b0c3637e50 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.449321 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9e7ecd3c-b91f-406d-9b4f-35b0c3637e50 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.614650 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:40.626918 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1afd6da8-9db1-40ba-8916-81ae13159b31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:40.630425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9e7ecd3c-b91f-406d-9b4f-35b0c3637e50 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:40.634626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1afd6da8-9db1-40ba-8916-81ae13159b31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.228150 Jun 15 10:21:40.635198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 535/1052] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:40 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:40.636080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=6 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:40.638784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9e7ecd3c-b91f-406d-9b4f-35b0c3637e50 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1666 microversion: 2.1 time: 0.201297 Jun 15 10:21:40.639488 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 518/1053] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:40 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1666 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:40.639901 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c56f7a25-02d7-4080-94d3-9733cc4fdcc2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:40.640576 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c56f7a25-02d7-4080-94d3-9733cc4fdcc2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:40.646653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c56f7a25-02d7-4080-94d3-9733cc4fdcc2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.647111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c56f7a25-02d7-4080-94d3-9733cc4fdcc2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.647921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c56f7a25-02d7-4080-94d3-9733cc4fdcc2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:40.648370 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c56f7a25-02d7-4080-94d3-9733cc4fdcc2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:40.799497 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c56f7a25-02d7-4080-94d3-9733cc4fdcc2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:40.807545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c56f7a25-02d7-4080-94d3-9733cc4fdcc2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1756 microversion: 2.1 time: 0.171411 Jun 15 10:21:40.808114 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 536/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:40 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:41.422208 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-875cd566-bcc2-43ee-9e0a-e4090592411b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:41.422840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-875cd566-bcc2-43ee-9e0a-e4090592411b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:41.429702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875cd566-bcc2-43ee-9e0a-e4090592411b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:41.430145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875cd566-bcc2-43ee-9e0a-e4090592411b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:41.430940 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875cd566-bcc2-43ee-9e0a-e4090592411b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:41.431370 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-875cd566-bcc2-43ee-9e0a-e4090592411b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:41.432821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3401177c-2f6c-4a34-8236-f18a265e244c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:41.433534 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3401177c-2f6c-4a34-8236-f18a265e244c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:41.436086 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.442323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3401177c-2f6c-4a34-8236-f18a265e244c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:41.442777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3401177c-2f6c-4a34-8236-f18a265e244c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:41.443543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3401177c-2f6c-4a34-8236-f18a265e244c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:41.443981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3401177c-2f6c-4a34-8236-f18a265e244c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:41.637003 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-875cd566-bcc2-43ee-9e0a-e4090592411b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:41.641104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3401177c-2f6c-4a34-8236-f18a265e244c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:41.645638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-875cd566-bcc2-43ee-9e0a-e4090592411b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.227207 Jun 15 10:21:41.646438 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 519/1055] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:41 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:41.650022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3401177c-2f6c-4a34-8236-f18a265e244c tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1691 microversion: 2.1 time: 0.221197 Jun 15 10:21:41.650752 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 537/1056] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:41 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:41.651080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-01015db5-266f-49c2-a26e-e408e135d93c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:41.651838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-01015db5-266f-49c2-a26e-e408e135d93c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:41.658105 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01015db5-266f-49c2-a26e-e408e135d93c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:41.659579 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01015db5-266f-49c2-a26e-e408e135d93c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:41.662564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01015db5-266f-49c2-a26e-e408e135d93c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:41.663025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-01015db5-266f-49c2-a26e-e408e135d93c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:41.824117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-01015db5-266f-49c2-a26e-e408e135d93c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:41.827946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f796716d-28bf-4e64-8bd9-77407b565df9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:41.829209 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f796716d-28bf-4e64-8bd9-77407b565df9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:41.839316 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f796716d-28bf-4e64-8bd9-77407b565df9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:41.840198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f796716d-28bf-4e64-8bd9-77407b565df9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:41.841484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f796716d-28bf-4e64-8bd9-77407b565df9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:41.842006 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f796716d-28bf-4e64-8bd9-77407b565df9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:41.846511 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-01015db5-266f-49c2-a26e-e408e135d93c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.198775 Jun 15 10:21:41.847109 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 520/1057] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:41 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:42.020737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f796716d-28bf-4e64-8bd9-77407b565df9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:42.029039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f796716d-28bf-4e64-8bd9-77407b565df9 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1759 microversion: 2.1 time: 0.207705 Jun 15 10:21:42.029624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 538/1058] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:41 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1759 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:42.665088 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e3ab2fdf-426c-4c51-a44b-dd2bdc6439b6 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:42.665717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e3ab2fdf-426c-4c51-a44b-dd2bdc6439b6 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:42.668645 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ea4007d6-3dab-4416-a3b7-789b6d43ec90 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:42.669272 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ea4007d6-3dab-4416-a3b7-789b6d43ec90 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:42.672825 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3ab2fdf-426c-4c51-a44b-dd2bdc6439b6 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:42.673345 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3ab2fdf-426c-4c51-a44b-dd2bdc6439b6 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:42.674807 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3ab2fdf-426c-4c51-a44b-dd2bdc6439b6 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:42.675294 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3ab2fdf-426c-4c51-a44b-dd2bdc6439b6 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:42.676516 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea4007d6-3dab-4416-a3b7-789b6d43ec90 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:42.676974 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea4007d6-3dab-4416-a3b7-789b6d43ec90 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:42.677763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea4007d6-3dab-4416-a3b7-789b6d43ec90 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:42.678493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ea4007d6-3dab-4416-a3b7-789b6d43ec90 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:42.913682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e3ab2fdf-426c-4c51-a44b-dd2bdc6439b6 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:42.919057 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-ea4007d6-3dab-4416-a3b7-789b6d43ec90 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:42.921926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e3ab2fdf-426c-4c51-a44b-dd2bdc6439b6 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.260733 Jun 15 10:21:42.931817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 521/1059] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:42 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:42.931817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3346a225-00bc-47a8-9d31-cba382376c96 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:42.931817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3346a225-00bc-47a8-9d31-cba382376c96 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:42.935552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3346a225-00bc-47a8-9d31-cba382376c96 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:42.936082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3346a225-00bc-47a8-9d31-cba382376c96 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:42.937087 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3346a225-00bc-47a8-9d31-cba382376c96 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:42.937725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3346a225-00bc-47a8-9d31-cba382376c96 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:42.938430 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ea4007d6-3dab-4416-a3b7-789b6d43ec90 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1691 microversion: 2.1 time: 0.273666 Jun 15 10:21:42.948012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 539/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:42 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1691 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:43.072055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3346a225-00bc-47a8-9d31-cba382376c96 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:43.080108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3346a225-00bc-47a8-9d31-cba382376c96 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.156167 Jun 15 10:21:43.080682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 522/1061] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:42 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:43.149495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-b0af73c5-5196-4dc9-9fce-dc0d5468afa4 req-adab650d-44ff-4bcc-bf3c-de0ca3502831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297abce4-955d-4411-8d84-3b14a31c5f19", "name": "network-vif-deleted", "tag": "0b2590ec-78e7-4638-85b3-4f3cb8ab82ec"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:43.157470 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-b0af73c5-5196-4dc9-9fce-dc0d5468afa4 req-adab650d-44ff-4bcc-bf3c-de0ca3502831 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:43.157913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-b0af73c5-5196-4dc9-9fce-dc0d5468afa4 req-adab650d-44ff-4bcc-bf3c-de0ca3502831 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:43.168604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-b0af73c5-5196-4dc9-9fce-dc0d5468afa4 req-adab650d-44ff-4bcc-bf3c-de0ca3502831 service nova] Creating event network-vif-deleted:0b2590ec-78e7-4638-85b3-4f3cb8ab82ec for instance 297abce4-955d-4411-8d84-3b14a31c5f19 on hv-cinder-83028 Jun 15 10:21:43.173530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-b0af73c5-5196-4dc9-9fce-dc0d5468afa4 req-adab650d-44ff-4bcc-bf3c-de0ca3502831 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027702 Jun 15 10:21:43.174120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 540/1062] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:43.940445 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d846090a-7ce6-4ddc-93ca-d9a7f703d513 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:43.941078 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d846090a-7ce6-4ddc-93ca-d9a7f703d513 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:43.947703 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d846090a-7ce6-4ddc-93ca-d9a7f703d513 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:43.948159 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d846090a-7ce6-4ddc-93ca-d9a7f703d513 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:43.948926 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d846090a-7ce6-4ddc-93ca-d9a7f703d513 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:43.949415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d846090a-7ce6-4ddc-93ca-d9a7f703d513 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:43.957224 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:43.958091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:43.964598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:43.965192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:43.966428 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:43.966962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:44.003108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:44.003746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:44.004061 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lazy-loading 'fault' on Instance uuid 297abce4-955d-4411-8d84-3b14a31c5f19 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:21:44.061904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:44.069948 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cc843ad8-0836-4bd3-afa1-f6a714acd9b1 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 200 len: 1336 microversion: 2.1 time: 0.117422 Jun 15 10:21:44.070805 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 541/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:43 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:44.097134 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-107f5017-56fb-421b-ba7a-75b482fc594a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:44.097756 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-107f5017-56fb-421b-ba7a-75b482fc594a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:44.109646 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-107f5017-56fb-421b-ba7a-75b482fc594a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:44.110104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-107f5017-56fb-421b-ba7a-75b482fc594a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:44.111622 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-107f5017-56fb-421b-ba7a-75b482fc594a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:44.112682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-107f5017-56fb-421b-ba7a-75b482fc594a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:44.127916 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d846090a-7ce6-4ddc-93ca-d9a7f703d513 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:44.136780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d846090a-7ce6-4ddc-93ca-d9a7f703d513 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1573 microversion: 2.1 time: 0.200367 Jun 15 10:21:44.141703 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 523/1064] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:43 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1573 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:44.252923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-107f5017-56fb-421b-ba7a-75b482fc594a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:44.260366 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-107f5017-56fb-421b-ba7a-75b482fc594a tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.167351 Jun 15 10:21:44.260941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 542/1065] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:44 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:45.087474 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:45.088040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: 297abce4-955d-4411-8d84-3b14a31c5f19] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:45.094952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:45.095394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:45.096157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:45.096591 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:45.110539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] HTTP exception thrown: Instance 297abce4-955d-4411-8d84-3b14a31c5f19 could not be found. Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Request method failure captured: Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 HTTP/1.1 Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDPGezxxUQhZoaRjOmjrO4GX92zTzIAGqRYvqhrgqzKMZJIzwRhp-N5Kk83Zyn3ltxZRD6XjCZa2blxpkLuR7Y-Z5PlRaz8ttddyzvl6Xybpv8K1RH3cYLJ3CwaO5vx0IuHkZqaEM8vB3PMESABts-q1r3IwamZYcHJ0pbJcMdiMqI Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:21:45.112205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea38be6c5c604346974bc9acac9628cd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: a3ee143a68b64f6f84e569b2b1823c5c Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 297abce4-955d-4411-8d84-3b14a31c5f19 could not be found. Jun 15 10:21:45.113587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '297abce4-955d-4411-8d84-3b14a31c5f19'} Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297abce4-955d-4411-8d84-3b14a31c5f19 could not be found. Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:21:45.114451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297abce4-955d-4411-8d84-3b14a31c5f19 could not be found. Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297abce4-955d-4411-8d84-3b14a31c5f19 could not be found. Jun 15 10:21:45.115756 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:45.116920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Returning 404 to user: Instance 297abce4-955d-4411-8d84-3b14a31c5f19 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:21:45.116920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-16385680-de51-4eac-9301-dea9310a95cc tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19" status: 404 len: 111 microversion: 2.1 time: 0.030095 Jun 15 10:21:45.116920 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 524/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:45 2022] GET /compute/v2.1/servers/297abce4-955d-4411-8d84-3b14a31c5f19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:21:45.123275 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-19d5f19a-7a35-4624-97bc-d1268bf65059 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '.version_select at 0x7fe255e0fa60>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:45.140373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-19d5f19a-7a35-4624-97bc-d1268bf65059 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116850726" status: 202 len: 0 microversion: 2.1 time: 0.021698 Jun 15 10:21:45.140921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 543/1067] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 10:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116850726 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:21:45.161163 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-03d2852d-7271-4662-bfba-bef03da91c9b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:45.162459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-03d2852d-7271-4662-bfba-bef03da91c9b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:45.169258 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03d2852d-7271-4662-bfba-bef03da91c9b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:45.169830 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03d2852d-7271-4662-bfba-bef03da91c9b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:45.170645 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03d2852d-7271-4662-bfba-bef03da91c9b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:45.171084 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-03d2852d-7271-4662-bfba-bef03da91c9b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:45.279708 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-53236fd6-844d-4928-aa1a-260b0c83927d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:45.280313 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-53236fd6-844d-4928-aa1a-260b0c83927d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:45.287435 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-53236fd6-844d-4928-aa1a-260b0c83927d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:45.287882 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-53236fd6-844d-4928-aa1a-260b0c83927d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:45.288652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-53236fd6-844d-4928-aa1a-260b0c83927d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:45.289091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-53236fd6-844d-4928-aa1a-260b0c83927d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:45.388894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-03d2852d-7271-4662-bfba-bef03da91c9b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:45.397104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-03d2852d-7271-4662-bfba-bef03da91c9b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1560 microversion: 2.1 time: 0.240705 Jun 15 10:21:45.397970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 525/1068] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:45 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:45.559975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-53236fd6-844d-4928-aa1a-260b0c83927d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:45.571542 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-53236fd6-844d-4928-aa1a-260b0c83927d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.296064 Jun 15 10:21:45.581761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 544/1069] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:45 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:46.589724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-073fabe6-e608-421c-8c50-61cceceaf1fa tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:46.590738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-073fabe6-e608-421c-8c50-61cceceaf1fa tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:46.598881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-073fabe6-e608-421c-8c50-61cceceaf1fa tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:46.599739 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-073fabe6-e608-421c-8c50-61cceceaf1fa tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:46.600534 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-073fabe6-e608-421c-8c50-61cceceaf1fa tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:46.600976 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-073fabe6-e608-421c-8c50-61cceceaf1fa tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:46.736101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-073fabe6-e608-421c-8c50-61cceceaf1fa tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:46.743466 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-073fabe6-e608-421c-8c50-61cceceaf1fa tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.158381 Jun 15 10:21:46.744026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 526/1070] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:46 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:47.760065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-250fa541-b419-4837-9e43-704f171cc878 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:47.760714 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-250fa541-b419-4837-9e43-704f171cc878 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:47.767983 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-250fa541-b419-4837-9e43-704f171cc878 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:47.768437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-250fa541-b419-4837-9e43-704f171cc878 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:47.769202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-250fa541-b419-4837-9e43-704f171cc878 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:47.769640 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-250fa541-b419-4837-9e43-704f171cc878 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:47.903172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-250fa541-b419-4837-9e43-704f171cc878 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:47.910739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-250fa541-b419-4837-9e43-704f171cc878 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.154587 Jun 15 10:21:47.911307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 545/1071] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:47 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:48.156303 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-44379e53-5359-464a-8b0d-1d44f2ce8175 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:48.156811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-44379e53-5359-464a-8b0d-1d44f2ce8175 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:48.163280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44379e53-5359-464a-8b0d-1d44f2ce8175 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:48.163746 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44379e53-5359-464a-8b0d-1d44f2ce8175 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:48.164811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44379e53-5359-464a-8b0d-1d44f2ce8175 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:48.165554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-44379e53-5359-464a-8b0d-1d44f2ce8175 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:48.193542 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-44379e53-5359-464a-8b0d-1d44f2ce8175 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:21:48.267918 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-44379e53-5359-464a-8b0d-1d44f2ce8175 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 204 len: 0 microversion: 2.1 time: 0.115926 Jun 15 10:21:48.268494 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 527/1072] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:21:48 2022] DELETE /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:48.276401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-19b6ffa9-25b2-4e2e-ad6f-a7b1482abc60 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:48.277023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-19b6ffa9-25b2-4e2e-ad6f-a7b1482abc60 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:48.284065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19b6ffa9-25b2-4e2e-ad6f-a7b1482abc60 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:48.284520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19b6ffa9-25b2-4e2e-ad6f-a7b1482abc60 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:48.285290 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19b6ffa9-25b2-4e2e-ad6f-a7b1482abc60 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:48.285730 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19b6ffa9-25b2-4e2e-ad6f-a7b1482abc60 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:48.414503 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-19b6ffa9-25b2-4e2e-ad6f-a7b1482abc60 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:48.416780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=100 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.423868 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-19b6ffa9-25b2-4e2e-ad6f-a7b1482abc60 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1507 microversion: 2.1 time: 0.151327 Jun 15 10:21:48.424437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 546/1073] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:48 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:48.929070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e0329d07-a811-47ca-b63b-ec121a71c847 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:48.929775 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e0329d07-a811-47ca-b63b-ec121a71c847 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:48.936430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0329d07-a811-47ca-b63b-ec121a71c847 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:48.936881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0329d07-a811-47ca-b63b-ec121a71c847 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:48.937648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0329d07-a811-47ca-b63b-ec121a71c847 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:48.938089 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e0329d07-a811-47ca-b63b-ec121a71c847 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:49.073172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e0329d07-a811-47ca-b63b-ec121a71c847 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:49.081201 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e0329d07-a811-47ca-b63b-ec121a71c847 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.156457 Jun 15 10:21:49.081777 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 528/1074] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:48 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:49.441155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b685102e-9942-45b2-b977-0cf6f9bb1034 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:49.441774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b685102e-9942-45b2-b977-0cf6f9bb1034 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:49.448429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b685102e-9942-45b2-b977-0cf6f9bb1034 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:49.448888 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b685102e-9942-45b2-b977-0cf6f9bb1034 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:49.449691 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b685102e-9942-45b2-b977-0cf6f9bb1034 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:49.450221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b685102e-9942-45b2-b977-0cf6f9bb1034 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:49.576815 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b685102e-9942-45b2-b977-0cf6f9bb1034 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:49.584252 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b685102e-9942-45b2-b977-0cf6f9bb1034 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1507 microversion: 2.1 time: 0.146994 Jun 15 10:21:49.584832 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 547/1075] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:49 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:50.075915 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-edc09284-6e79-4d66-9492-fb6accb9b28a req-a0512e5d-c055-4646-9431-5590998c2b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf", "name": "network-vif-deleted", "tag": "46ca2b51-7c1c-444b-8134-9d5e61874f98"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:50.084521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-edc09284-6e79-4d66-9492-fb6accb9b28a req-a0512e5d-c055-4646-9431-5590998c2b7f service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:50.084963 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-edc09284-6e79-4d66-9492-fb6accb9b28a req-a0512e5d-c055-4646-9431-5590998c2b7f service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:50.099490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-edc09284-6e79-4d66-9492-fb6accb9b28a req-a0512e5d-c055-4646-9431-5590998c2b7f service nova] Creating event network-vif-deleted:46ca2b51-7c1c-444b-8134-9d5e61874f98 for instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf on hv-cinder-83028 Jun 15 10:21:50.104335 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-edc09284-6e79-4d66-9492-fb6accb9b28a req-a0512e5d-c055-4646-9431-5590998c2b7f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032997 Jun 15 10:21:50.105377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 529/1076] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:50.107153 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0731cd09-0b3e-4835-8d89-eac36af8bd2e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:50.108147 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0731cd09-0b3e-4835-8d89-eac36af8bd2e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:50.115862 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0731cd09-0b3e-4835-8d89-eac36af8bd2e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:50.116321 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0731cd09-0b3e-4835-8d89-eac36af8bd2e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:50.117939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0731cd09-0b3e-4835-8d89-eac36af8bd2e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:50.117939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0731cd09-0b3e-4835-8d89-eac36af8bd2e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:50.262490 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0731cd09-0b3e-4835-8d89-eac36af8bd2e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:50.272220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0731cd09-0b3e-4835-8d89-eac36af8bd2e tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.178526 Jun 15 10:21:50.272801 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 548/1077] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:50 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:50.603327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:50.604112 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:50.612977 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:50.613430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:50.614309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:50.614794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:50.648599 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:50.649121 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:50.649648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lazy-loading 'fault' on Instance uuid d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:21:50.693411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:50.701068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1a4eb04f-bade-4f41-93a6-6c3e4e99cd56 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 200 len: 1311 microversion: 2.1 time: 0.103279 Jun 15 10:21:50.701637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 530/1078] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:50 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:51.288910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e8d675db-1a9b-47f2-a186-1de876dcbee7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:51.289600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e8d675db-1a9b-47f2-a186-1de876dcbee7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:51.297286 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8d675db-1a9b-47f2-a186-1de876dcbee7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:51.297743 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8d675db-1a9b-47f2-a186-1de876dcbee7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:51.298817 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8d675db-1a9b-47f2-a186-1de876dcbee7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:51.299271 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e8d675db-1a9b-47f2-a186-1de876dcbee7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:51.440097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e8d675db-1a9b-47f2-a186-1de876dcbee7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:51.447610 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e8d675db-1a9b-47f2-a186-1de876dcbee7 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.162693 Jun 15 10:21:51.448392 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 549/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:51 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:51.720320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:51.720930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:51.727412 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:51.727870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:51.728625 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:51.729059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:51.733271 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:51.743750 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] HTTP exception thrown: Instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf could not be found. Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Request method failure captured: Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf HTTP/1.1 Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDPGezxxUQhZoaRjOmjrO4GX92zTzIAGqRYvqhrgqzKMZJIzwRhp-N5Kk83Zyn3ltxZRD6XjCZa2blxpkLuR7Y-Z5PlRaz8ttddyzvl6Xybpv8K1RH3cYLJ3CwaO5vx0IuHkZqaEM8vB3PMESABts-q1r3IwamZYcHJ0pbJcMdiMqI Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:21:51.745477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea38be6c5c604346974bc9acac9628cd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: a3ee143a68b64f6f84e569b2b1823c5c Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf could not be found. Jun 15 10:21:51.747338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'd4e2f10f-8291-4024-8bc1-d0cb09b7d1bf'} Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf could not be found. Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:21:51.748274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf could not be found. Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf could not be found. Jun 15 10:21:51.749729 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:51.751180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Returning 404 to user: Instance d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:21:51.751180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-808784df-2e20-403e-9b84-5d8af176ce51 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf" status: 404 len: 111 microversion: 2.1 time: 0.032649 Jun 15 10:21:51.751180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 531/1080] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:51 2022] GET /compute/v2.1/servers/d4e2f10f-8291-4024-8bc1-d0cb09b7d1bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:21:51.756055 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-76b740e4-5150-4987-ae73-f84736cf2f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:51.756559 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-76b740e4-5150-4987-ae73-f84736cf2f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:51.763748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76b740e4-5150-4987-ae73-f84736cf2f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:51.764206 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76b740e4-5150-4987-ae73-f84736cf2f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:51.764975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76b740e4-5150-4987-ae73-f84736cf2f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:51.765417 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-76b740e4-5150-4987-ae73-f84736cf2f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:51.790214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-76b740e4-5150-4987-ae73-f84736cf2f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:21:51.870336 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-76b740e4-5150-4987-ae73-f84736cf2f35 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 204 len: 0 microversion: 2.1 time: 0.117847 Jun 15 10:21:51.870940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 550/1081] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:21:51 2022] DELETE /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:51.880410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b55a1429-0c54-42ab-bdb4-caba1c41df72 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:51.881027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b55a1429-0c54-42ab-bdb4-caba1c41df72 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:51.888867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b55a1429-0c54-42ab-bdb4-caba1c41df72 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:51.889320 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b55a1429-0c54-42ab-bdb4-caba1c41df72 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:51.890091 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b55a1429-0c54-42ab-bdb4-caba1c41df72 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:51.890559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b55a1429-0c54-42ab-bdb4-caba1c41df72 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:52.021793 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b55a1429-0c54-42ab-bdb4-caba1c41df72 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:52.029293 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b55a1429-0c54-42ab-bdb4-caba1c41df72 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.153254 Jun 15 10:21:52.029860 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 532/1082] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:51 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:52.464771 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f5fdec93-6dad-4657-bc22-2d6e268611ef tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:52.465484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f5fdec93-6dad-4657-bc22-2d6e268611ef tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:52.472585 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f5fdec93-6dad-4657-bc22-2d6e268611ef tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:52.473044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f5fdec93-6dad-4657-bc22-2d6e268611ef tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:52.473824 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f5fdec93-6dad-4657-bc22-2d6e268611ef tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:52.474504 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f5fdec93-6dad-4657-bc22-2d6e268611ef tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:52.615879 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f5fdec93-6dad-4657-bc22-2d6e268611ef tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:52.624488 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f5fdec93-6dad-4657-bc22-2d6e268611ef tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.163807 Jun 15 10:21:52.624993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 551/1083] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:52 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:53.047350 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f74b7006-64d6-4fb6-9888-61bbb972a7f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:53.047974 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f74b7006-64d6-4fb6-9888-61bbb972a7f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:53.054489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f74b7006-64d6-4fb6-9888-61bbb972a7f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:53.054945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f74b7006-64d6-4fb6-9888-61bbb972a7f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:53.055723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f74b7006-64d6-4fb6-9888-61bbb972a7f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:53.056164 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f74b7006-64d6-4fb6-9888-61bbb972a7f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:53.286562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f74b7006-64d6-4fb6-9888-61bbb972a7f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:53.297299 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f74b7006-64d6-4fb6-9888-61bbb972a7f9 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1522 microversion: 2.1 time: 0.254202 Jun 15 10:21:53.297888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 533/1084] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:53 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:53.642098 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2c4db34a-116c-4401-8dbd-442a90653fff tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:53.643760 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2c4db34a-116c-4401-8dbd-442a90653fff tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:53.652941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c4db34a-116c-4401-8dbd-442a90653fff tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:53.653652 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c4db34a-116c-4401-8dbd-442a90653fff tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:53.654782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c4db34a-116c-4401-8dbd-442a90653fff tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:53.655237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2c4db34a-116c-4401-8dbd-442a90653fff tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:53.773229 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-a98bf527-7994-41e6-9b40-283858f22a5b req-f0c35288-539b-4df1-8d8d-62d34e4683a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3108892e-7e39-4745-9fe8-def8a153e577", "name": "network-vif-plugged", "status": "completed", "tag": "2351e726-d5be-48b8-b869-58a22c8cf327"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:53.783192 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a98bf527-7994-41e6-9b40-283858f22a5b req-f0c35288-539b-4df1-8d8d-62d34e4683a8 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:53.783733 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a98bf527-7994-41e6-9b40-283858f22a5b req-f0c35288-539b-4df1-8d8d-62d34e4683a8 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:53.795871 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-a98bf527-7994-41e6-9b40-283858f22a5b req-f0c35288-539b-4df1-8d8d-62d34e4683a8 service nova] Creating event network-vif-plugged:2351e726-d5be-48b8-b869-58a22c8cf327 for instance 3108892e-7e39-4745-9fe8-def8a153e577 on hv-cinder-83028 Jun 15 10:21:53.800747 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-a98bf527-7994-41e6-9b40-283858f22a5b req-f0c35288-539b-4df1-8d8d-62d34e4683a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031263 Jun 15 10:21:53.801672 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 534/1085] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:53.818591 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-594b3ea0-b2a2-4426-913f-3e9eab70ff0c req-8a86f328-6ab8-42b4-aca4-8e5f37f9a0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea751c2f-c929-4939-b72c-70a5487bba0a", "name": "network-vif-deleted", "tag": "f8d02131-5cb5-405d-8ed7-13f30cd0921e"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:53.831108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-594b3ea0-b2a2-4426-913f-3e9eab70ff0c req-8a86f328-6ab8-42b4-aca4-8e5f37f9a0ab service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:53.834807 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-594b3ea0-b2a2-4426-913f-3e9eab70ff0c req-8a86f328-6ab8-42b4-aca4-8e5f37f9a0ab service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:53.851122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-594b3ea0-b2a2-4426-913f-3e9eab70ff0c req-8a86f328-6ab8-42b4-aca4-8e5f37f9a0ab service nova] Creating event network-vif-deleted:f8d02131-5cb5-405d-8ed7-13f30cd0921e for instance ea751c2f-c929-4939-b72c-70a5487bba0a on hv-cinder-83028 Jun 15 10:21:53.857375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-594b3ea0-b2a2-4426-913f-3e9eab70ff0c req-8a86f328-6ab8-42b4-aca4-8e5f37f9a0ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045196 Jun 15 10:21:53.858528 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 535/1086] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:53.906379 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2c4db34a-116c-4401-8dbd-442a90653fff tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:53.914557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2c4db34a-116c-4401-8dbd-442a90653fff tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.276112 Jun 15 10:21:53.915256 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 552/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:53 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:54.315651 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:54.316363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:54.322664 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:54.323134 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:54.323882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:54.325343 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:54.356975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:54.357420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:54.357866 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lazy-loading 'fault' on Instance uuid ea751c2f-c929-4939-b72c-70a5487bba0a {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:21:54.404456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee143a68b64f6f84e569b2b1823c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea38be6c5c604346974bc9acac9628cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:54.412008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-108d451c-d25c-4dcf-ad6f-55b726a995b4 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 200 len: 1312 microversion: 2.1 time: 0.101032 Jun 15 10:21:54.412585 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 536/1088] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:54 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:54.932598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-71775fc1-962a-4cad-83fe-06d5eeb66e7b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:54.933337 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-71775fc1-962a-4cad-83fe-06d5eeb66e7b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:54.940809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71775fc1-962a-4cad-83fe-06d5eeb66e7b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:54.941272 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71775fc1-962a-4cad-83fe-06d5eeb66e7b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:54.942065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71775fc1-962a-4cad-83fe-06d5eeb66e7b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:54.942544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-71775fc1-962a-4cad-83fe-06d5eeb66e7b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:55.075654 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-71775fc1-962a-4cad-83fe-06d5eeb66e7b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:55.083477 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-71775fc1-962a-4cad-83fe-06d5eeb66e7b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1265 microversion: 2.1 time: 0.154888 Jun 15 10:21:55.084039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 553/1089] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:54 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:55.428952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:55.429558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] [instance: ea751c2f-c929-4939-b72c-70a5487bba0a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:55.437063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:55.437513 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:55.438292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:55.438724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:55.452299 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] HTTP exception thrown: Instance ea751c2f-c929-4939-b72c-70a5487bba0a could not be found. Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Request method failure captured: Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a HTTP/1.1 Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDPGezxxUQhZoaRjOmjrO4GX92zTzIAGqRYvqhrgqzKMZJIzwRhp-N5Kk83Zyn3ltxZRD6XjCZa2blxpkLuR7Y-Z5PlRaz8ttddyzvl6Xybpv8K1RH3cYLJ3CwaO5vx0IuHkZqaEM8vB3PMESABts-q1r3IwamZYcHJ0pbJcMdiMqI Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:21:55.453937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea38be6c5c604346974bc9acac9628cd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea38be6c5c604346974bc9acac9628cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: ea38be6c5c604346974bc9acac9628cd Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1829646881 Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: a3ee143a68b64f6f84e569b2b1823c5c Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1829646881-project Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance ea751c2f-c929-4939-b72c-70a5487bba0a could not be found. Jun 15 10:21:55.455391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'ea751c2f-c929-4939-b72c-70a5487bba0a'} Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea751c2f-c929-4939-b72c-70a5487bba0a could not be found. Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:21:55.456104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea751c2f-c929-4939-b72c-70a5487bba0a could not be found. Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea751c2f-c929-4939-b72c-70a5487bba0a could not be found. Jun 15 10:21:55.457538 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:21:55.458865 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] Returning 404 to user: Instance ea751c2f-c929-4939-b72c-70a5487bba0a could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:21:55.458865 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ff4a0067-bbd4-4821-b583-95f78f752a79 tempest-ServerRescueNegativeTestJSON-1829646881 tempest-ServerRescueNegativeTestJSON-1829646881-project] 10.222.0.57 "GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a" status: 404 len: 111 microversion: 2.1 time: 0.030242 Jun 15 10:21:55.458865 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 537/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:55 2022] GET /compute/v2.1/servers/ea751c2f-c929-4939-b72c-70a5487bba0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:21:56.099653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b782e141-d9b8-4fc4-82aa-fa6cb0660dd3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:56.100583 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b782e141-d9b8-4fc4-82aa-fa6cb0660dd3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:56.108930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b782e141-d9b8-4fc4-82aa-fa6cb0660dd3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:56.109447 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b782e141-d9b8-4fc4-82aa-fa6cb0660dd3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:56.110182 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b782e141-d9b8-4fc4-82aa-fa6cb0660dd3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:56.110973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b782e141-d9b8-4fc4-82aa-fa6cb0660dd3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:56.316344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b782e141-d9b8-4fc4-82aa-fa6cb0660dd3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:56.323791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b782e141-d9b8-4fc4-82aa-fa6cb0660dd3 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1451 microversion: 2.1 time: 0.227998 Jun 15 10:21:56.324924 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 554/1091] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:56 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1451 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:56.340241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a0088d79-81f0-40a3-b480-9f9b10bd6048 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:56.340892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a0088d79-81f0-40a3-b480-9f9b10bd6048 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:56.347218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0088d79-81f0-40a3-b480-9f9b10bd6048 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:56.347675 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0088d79-81f0-40a3-b480-9f9b10bd6048 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:56.348449 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0088d79-81f0-40a3-b480-9f9b10bd6048 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:56.348911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a0088d79-81f0-40a3-b480-9f9b10bd6048 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:56.576406 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a0088d79-81f0-40a3-b480-9f9b10bd6048 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:56.584275 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a0088d79-81f0-40a3-b480-9f9b10bd6048 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1451 microversion: 2.1 time: 0.247840 Jun 15 10:21:56.584859 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 538/1092] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:56 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1451 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:58.336957 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-00c29e6a-d432-496a-8948-b2105455d306 req-3dc288f5-cac3-4e93-8d0d-2958e1f1d502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3108892e-7e39-4745-9fe8-def8a153e577", "tag": "2351e726-d5be-48b8-b869-58a22c8cf327"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:58.346658 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-00c29e6a-d432-496a-8948-b2105455d306 req-3dc288f5-cac3-4e93-8d0d-2958e1f1d502 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:58.347103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-00c29e6a-d432-496a-8948-b2105455d306 req-3dc288f5-cac3-4e93-8d0d-2958e1f1d502 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:58.359371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-00c29e6a-d432-496a-8948-b2105455d306 req-3dc288f5-cac3-4e93-8d0d-2958e1f1d502 service nova] Creating event network-changed:2351e726-d5be-48b8-b869-58a22c8cf327 for instance 3108892e-7e39-4745-9fe8-def8a153e577 on hv-cinder-83028 Jun 15 10:21:58.365982 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-00c29e6a-d432-496a-8948-b2105455d306 req-3dc288f5-cac3-4e93-8d0d-2958e1f1d502 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032798 Jun 15 10:21:58.366762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 555/1093] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:04.967040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-92273578-8af6-4f4b-8822-35abea2383de tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: .version_select at 0x7fe2560a1a60>, body: {"keypair": {"name": "tempest-keypair-2129408435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbmC1h3YZa4jy+V2Z6U9xloNTlIg76qBZtR2/70lvPoxzA+yt6KFndwaqgeJi0Hz05jz9Vlyw4h63vh4v7A/bO2jNCCNQPAsbGuMJe2hVDEW/Mb7fb5k+iuT6njwe24JQ=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:04.986561 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-92273578-8af6-4f4b-8822-35abea2383de tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for project 64d59f3545044033ab48f6253122fe64. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:04.991015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-92273578-8af6-4f4b-8822-35abea2383de tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for user 016f3ad72de247f991f1939a987a4ffb and project 64d59f3545044033ab48f6253122fe64. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:05.018381 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-92273578-8af6-4f4b-8822-35abea2383de tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185835 Jun 15 10:22:05.019086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 539/1094] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:22:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:06.336305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1539090544", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a0c7486-be27-43d5-98e8-c4309dfe22aa"}], "security_groups": [{"name": "tempest-securitygroup--647994527"}], "key_name": "tempest-keypair-2129408435", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:06.441136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] validate_networks() for [('4a0c7486-be27-43d5-98e8-c4309dfe22aa', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:22:07.141834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:22:07.142177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:22:07.142686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:22:07.143112 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:22:07.143521 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:22:07.160384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:07.161206 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:07.162532 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:07.163088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:07.186422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for project 64d59f3545044033ab48f6253122fe64. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:07.190117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for user 016f3ad72de247f991f1939a987a4ffb and project 64d59f3545044033ab48f6253122fe64. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:07.202973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:22:07.205433 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:22:07.252484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-34dbd50e-b36a-4c9f-87a4-a827f0601ce6 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.921617 Jun 15 10:22:07.253267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 556/1095] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:22:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:22:07.264619 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4e0ed718-22d9-47eb-ab8f-50040657a9cf tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:07.265789 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4e0ed718-22d9-47eb-ab8f-50040657a9cf tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:07.268432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=32 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:07.359338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4e0ed718-22d9-47eb-ab8f-50040657a9cf tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:07.368231 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4e0ed718-22d9-47eb-ab8f-50040657a9cf tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1242 microversion: 2.1 time: 0.108787 Jun 15 10:22:07.368978 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 540/1096] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:07 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:08.387234 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-913ab8a3-2385-4507-896d-aa7d45dc62d4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:08.388588 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-913ab8a3-2385-4507-896d-aa7d45dc62d4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:08.395858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-913ab8a3-2385-4507-896d-aa7d45dc62d4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:08.396319 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-913ab8a3-2385-4507-896d-aa7d45dc62d4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:08.397128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-913ab8a3-2385-4507-896d-aa7d45dc62d4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:08.397565 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-913ab8a3-2385-4507-896d-aa7d45dc62d4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:08.519238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-913ab8a3-2385-4507-896d-aa7d45dc62d4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:08.531177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-913ab8a3-2385-4507-896d-aa7d45dc62d4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1302 microversion: 2.1 time: 0.148996 Jun 15 10:22:08.532052 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 557/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:08 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1302 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:09.550247 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3a5a1740-ab11-4b7a-9123-5c014b5dd1c5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:09.550901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3a5a1740-ab11-4b7a-9123-5c014b5dd1c5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:09.553358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:09.562074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a5a1740-ab11-4b7a-9123-5c014b5dd1c5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:09.562691 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a5a1740-ab11-4b7a-9123-5c014b5dd1c5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:09.563579 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a5a1740-ab11-4b7a-9123-5c014b5dd1c5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:09.564120 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3a5a1740-ab11-4b7a-9123-5c014b5dd1c5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:09.780110 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3a5a1740-ab11-4b7a-9123-5c014b5dd1c5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:09.787412 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3a5a1740-ab11-4b7a-9123-5c014b5dd1c5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.241452 Jun 15 10:22:09.787976 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 541/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:09 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:10.075041 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-2011ab32-6068-4385-b0cb-29835feeb462 req-010018c8-1a0b-46c5-a096-eb6119a75ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0c2e15-868c-49a1-8464-4ef339043aae", "tag": "4caeb751-19c4-4cb6-8dec-925f14000817"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:10.083844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-2011ab32-6068-4385-b0cb-29835feeb462 req-010018c8-1a0b-46c5-a096-eb6119a75ed7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:10.084287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-2011ab32-6068-4385-b0cb-29835feeb462 req-010018c8-1a0b-46c5-a096-eb6119a75ed7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:10.097449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-2011ab32-6068-4385-b0cb-29835feeb462 req-010018c8-1a0b-46c5-a096-eb6119a75ed7 service nova] Creating event network-changed:4caeb751-19c4-4cb6-8dec-925f14000817 for instance 2b0c2e15-868c-49a1-8464-4ef339043aae on hv-cinder-83028 Jun 15 10:22:10.102418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-2011ab32-6068-4385-b0cb-29835feeb462 req-010018c8-1a0b-46c5-a096-eb6119a75ed7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Jun 15 10:22:10.103541 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 558/1099] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:22:10.804883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0222bb78-cad7-4db0-aed2-5142edd48606 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:10.805497 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0222bb78-cad7-4db0-aed2-5142edd48606 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:10.812587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0222bb78-cad7-4db0-aed2-5142edd48606 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:10.813029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0222bb78-cad7-4db0-aed2-5142edd48606 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:10.813784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0222bb78-cad7-4db0-aed2-5142edd48606 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:10.814220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0222bb78-cad7-4db0-aed2-5142edd48606 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:10.949534 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0222bb78-cad7-4db0-aed2-5142edd48606 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:10.956903 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0222bb78-cad7-4db0-aed2-5142edd48606 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.155873 Jun 15 10:22:10.957478 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 542/1100] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:10 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:11.975085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3a5cbeab-07ee-423a-b93a-847e8adfb3b8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:11.975813 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3a5cbeab-07ee-423a-b93a-847e8adfb3b8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:11.977718 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:11.983822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a5cbeab-07ee-423a-b93a-847e8adfb3b8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:11.984269 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a5cbeab-07ee-423a-b93a-847e8adfb3b8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:11.985022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a5cbeab-07ee-423a-b93a-847e8adfb3b8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:11.985452 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3a5cbeab-07ee-423a-b93a-847e8adfb3b8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:12.116158 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3a5cbeab-07ee-423a-b93a-847e8adfb3b8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:12.124261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3a5cbeab-07ee-423a-b93a-847e8adfb3b8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.153869 Jun 15 10:22:12.124821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 559/1101] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:11 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:13.141657 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-45bdce9d-240b-4e43-adf2-7e73ab5b4e2e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:13.142321 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-45bdce9d-240b-4e43-adf2-7e73ab5b4e2e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:13.149104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-45bdce9d-240b-4e43-adf2-7e73ab5b4e2e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:13.149528 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-45bdce9d-240b-4e43-adf2-7e73ab5b4e2e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:13.150312 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-45bdce9d-240b-4e43-adf2-7e73ab5b4e2e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:13.150752 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-45bdce9d-240b-4e43-adf2-7e73ab5b4e2e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:13.284174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-45bdce9d-240b-4e43-adf2-7e73ab5b4e2e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:13.291634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-45bdce9d-240b-4e43-adf2-7e73ab5b4e2e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.153867 Jun 15 10:22:13.292801 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 543/1102] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:13 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:14.308919 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-83a438b6-f245-46e2-84c4-de4b8f10b8dc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:14.309538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-83a438b6-f245-46e2-84c4-de4b8f10b8dc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:14.316313 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83a438b6-f245-46e2-84c4-de4b8f10b8dc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:14.316769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83a438b6-f245-46e2-84c4-de4b8f10b8dc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:14.317539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83a438b6-f245-46e2-84c4-de4b8f10b8dc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:14.317979 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83a438b6-f245-46e2-84c4-de4b8f10b8dc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:14.447784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83a438b6-f245-46e2-84c4-de4b8f10b8dc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:14.456039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-83a438b6-f245-46e2-84c4-de4b8f10b8dc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.151043 Jun 15 10:22:14.456616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 560/1103] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:14 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:15.473735 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-21b83717-4e95-42da-b30e-74e1ad6a2a9f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:15.474367 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-21b83717-4e95-42da-b30e-74e1ad6a2a9f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:15.481958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21b83717-4e95-42da-b30e-74e1ad6a2a9f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:15.482464 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21b83717-4e95-42da-b30e-74e1ad6a2a9f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:15.484188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21b83717-4e95-42da-b30e-74e1ad6a2a9f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:15.484188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21b83717-4e95-42da-b30e-74e1ad6a2a9f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:15.620083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-21b83717-4e95-42da-b30e-74e1ad6a2a9f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:15.628020 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-21b83717-4e95-42da-b30e-74e1ad6a2a9f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.158223 Jun 15 10:22:15.628591 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 544/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:15 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:16.644952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-70456666-843a-4ca4-b265-bc5dc29ca25c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:16.645553 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-70456666-843a-4ca4-b265-bc5dc29ca25c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:16.652072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-70456666-843a-4ca4-b265-bc5dc29ca25c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:16.653202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-70456666-843a-4ca4-b265-bc5dc29ca25c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:16.654076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-70456666-843a-4ca4-b265-bc5dc29ca25c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:16.654566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-70456666-843a-4ca4-b265-bc5dc29ca25c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:16.785390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-70456666-843a-4ca4-b265-bc5dc29ca25c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:16.793567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-70456666-843a-4ca4-b265-bc5dc29ca25c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.151964 Jun 15 10:22:16.794548 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 561/1105] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:16 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:17.810560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eef37acc-9016-4f25-8b05-f27d03b43077 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:17.811178 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eef37acc-9016-4f25-8b05-f27d03b43077 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:17.813531 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=6 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.819085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eef37acc-9016-4f25-8b05-f27d03b43077 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:17.819533 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eef37acc-9016-4f25-8b05-f27d03b43077 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:17.820299 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eef37acc-9016-4f25-8b05-f27d03b43077 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:17.820728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eef37acc-9016-4f25-8b05-f27d03b43077 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:17.959898 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-eef37acc-9016-4f25-8b05-f27d03b43077 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:17.967713 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eef37acc-9016-4f25-8b05-f27d03b43077 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.161916 Jun 15 10:22:17.968704 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 545/1106] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:17 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:17.995500 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-c35fd28b-829c-429b-a30a-eb0e99ed6919 req-74d8b646-2683-4db8-a6d5-f7f609d532ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0c2e15-868c-49a1-8464-4ef339043aae", "name": "network-vif-plugged", "status": "completed", "tag": "4caeb751-19c4-4cb6-8dec-925f14000817"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:18.000069 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.000782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.007626 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-c35fd28b-829c-429b-a30a-eb0e99ed6919 req-74d8b646-2683-4db8-a6d5-f7f609d532ce service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.008082 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-c35fd28b-829c-429b-a30a-eb0e99ed6919 req-74d8b646-2683-4db8-a6d5-f7f609d532ce service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:18.019619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-c35fd28b-829c-429b-a30a-eb0e99ed6919 req-74d8b646-2683-4db8-a6d5-f7f609d532ce service nova] Creating event network-vif-plugged:4caeb751-19c4-4cb6-8dec-925f14000817 for instance 2b0c2e15-868c-49a1-8464-4ef339043aae on hv-cinder-83028 Jun 15 10:22:18.024391 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-c35fd28b-829c-429b-a30a-eb0e99ed6919 req-74d8b646-2683-4db8-a6d5-f7f609d532ce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032537 Jun 15 10:22:18.025037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 562/1107] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:22:18.984862 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af2a77fe-642c-410b-8b3a-c849d7f0acac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:18.985482 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af2a77fe-642c-410b-8b3a-c849d7f0acac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:18.992023 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af2a77fe-642c-410b-8b3a-c849d7f0acac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.992479 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af2a77fe-642c-410b-8b3a-c849d7f0acac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:18.993246 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af2a77fe-642c-410b-8b3a-c849d7f0acac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.993771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af2a77fe-642c-410b-8b3a-c849d7f0acac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:19.122978 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-af2a77fe-642c-410b-8b3a-c849d7f0acac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:19.130339 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-af2a77fe-642c-410b-8b3a-c849d7f0acac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.149770 Jun 15 10:22:19.130911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 546/1108] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:18 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:20.148952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-402fb3ad-b0ae-4923-938b-e91c61b487ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:20.149665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-402fb3ad-b0ae-4923-938b-e91c61b487ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:20.156977 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-402fb3ad-b0ae-4923-938b-e91c61b487ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:20.157451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-402fb3ad-b0ae-4923-938b-e91c61b487ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:20.158225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-402fb3ad-b0ae-4923-938b-e91c61b487ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:20.158694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-402fb3ad-b0ae-4923-938b-e91c61b487ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:20.163788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:20.293837 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-402fb3ad-b0ae-4923-938b-e91c61b487ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:20.301829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-402fb3ad-b0ae-4923-938b-e91c61b487ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1367 microversion: 2.1 time: 0.157591 Jun 15 10:22:20.302495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 563/1109] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:20 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:21.320024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4e775972-cb11-4df4-b7ba-09a3593776fb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:21.320647 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4e775972-cb11-4df4-b7ba-09a3593776fb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:21.327209 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e775972-cb11-4df4-b7ba-09a3593776fb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.328220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e775972-cb11-4df4-b7ba-09a3593776fb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.328985 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e775972-cb11-4df4-b7ba-09a3593776fb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.329429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4e775972-cb11-4df4-b7ba-09a3593776fb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.466886 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4e775972-cb11-4df4-b7ba-09a3593776fb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:21.474466 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4e775972-cb11-4df4-b7ba-09a3593776fb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1558 microversion: 2.1 time: 0.158478 Jun 15 10:22:21.475030 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 547/1110] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:21 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:21.491414 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-80506fe4-7272-4be9-aede-188ad16d5a86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:21.491923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-80506fe4-7272-4be9-aede-188ad16d5a86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:21.498634 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80506fe4-7272-4be9-aede-188ad16d5a86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.499818 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80506fe4-7272-4be9-aede-188ad16d5a86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.501068 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80506fe4-7272-4be9-aede-188ad16d5a86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.501547 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-80506fe4-7272-4be9-aede-188ad16d5a86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.577938 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-80506fe4-7272-4be9-aede-188ad16d5a86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090306 Jun 15 10:22:21.578576 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 564/1111] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 10:22:21 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:22.484793 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-d357d62f-89ba-4ca9-800d-b328937f1be4 req-773cbec7-5548-446a-8259-f38b998f95c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0c2e15-868c-49a1-8464-4ef339043aae", "tag": "4caeb751-19c4-4cb6-8dec-925f14000817"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:22.497931 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-d357d62f-89ba-4ca9-800d-b328937f1be4 req-773cbec7-5548-446a-8259-f38b998f95c3 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.498394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-d357d62f-89ba-4ca9-800d-b328937f1be4 req-773cbec7-5548-446a-8259-f38b998f95c3 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.510257 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-d357d62f-89ba-4ca9-800d-b328937f1be4 req-773cbec7-5548-446a-8259-f38b998f95c3 service nova] Creating event network-changed:4caeb751-19c4-4cb6-8dec-925f14000817 for instance 2b0c2e15-868c-49a1-8464-4ef339043aae on hv-cinder-83028 Jun 15 10:22:22.516094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-d357d62f-89ba-4ca9-800d-b328937f1be4 req-773cbec7-5548-446a-8259-f38b998f95c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034955 Jun 15 10:22:22.516870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 548/1112] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:45.435538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=11 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:45.436289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=9 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:45.440821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ce62d1db-f745-4823-8e29-a910b96be963 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:45.441347 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ce62d1db-f745-4823-8e29-a910b96be963 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:45.448012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ce62d1db-f745-4823-8e29-a910b96be963 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.448463 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ce62d1db-f745-4823-8e29-a910b96be963 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.449223 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ce62d1db-f745-4823-8e29-a910b96be963 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.449660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ce62d1db-f745-4823-8e29-a910b96be963 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.475664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ce62d1db-f745-4823-8e29-a910b96be963 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/ips" status: 200 len: 151 microversion: 2.20 time: 0.041568 Jun 15 10:22:45.476268 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 565/1113] 10.222.0.57 () {60 vars in 1288 bytes} [Wed Jun 15 10:22:45 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:47.322125 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a82c7cca-8345-48a2-a5ca-8b3e3b53ec3d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:47.322713 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a82c7cca-8345-48a2-a5ca-8b3e3b53ec3d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:47.325264 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=15 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:47.325914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=44 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:47.333052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a82c7cca-8345-48a2-a5ca-8b3e3b53ec3d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.333503 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a82c7cca-8345-48a2-a5ca-8b3e3b53ec3d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.334285 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a82c7cca-8345-48a2-a5ca-8b3e3b53ec3d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.334738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a82c7cca-8345-48a2-a5ca-8b3e3b53ec3d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.360643 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-a82c7cca-8345-48a2-a5ca-8b3e3b53ec3d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lazy-loading 'flavor' on Instance uuid dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:22:47.625249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a82c7cca-8345-48a2-a5ca-8b3e3b53ec3d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/action" status: 202 len: 0 microversion: 2.20 time: 0.306199 Jun 15 10:22:47.625888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 549/1114] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Jun 15 10:22:47 2022] POST /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:22:47.633912 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:47.634556 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:47.641746 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.642203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.643010 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.643477 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.773436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.781651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.783202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.784365 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-3b755442-9a74-4735-9284-d458bad60737 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.154286 Jun 15 10:22:47.784926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 566/1115] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:47 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:48.804233 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:48.804938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:48.812064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:48.812535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:48.813316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:48.813761 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:48.945566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:48.953630 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:48.955197 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:48.956363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4b27872d-f12d-4e72-96ff-f6357cec4ec9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.156876 Jun 15 10:22:48.956937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 550/1116] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:48 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:49.974773 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:49.975309 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:49.981723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:49.982177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:49.983733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:49.984425 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.115345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.123374 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.125624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.126809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-89041ca6-a2c0-4c46-915d-bf57c71e7807 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.155998 Jun 15 10:22:50.127473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 567/1117] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:49 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:51.145417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:51.146024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:51.152043 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.152491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.153243 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.153677 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.282114 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:51.290156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:51.291691 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:51.292835 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-408852f3-d546-4d15-b35e-d0a0c39ef221 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.151462 Jun 15 10:22:51.293386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 551/1118] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:51 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:52.312076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:52.312683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:52.319077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:52.319523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:52.320274 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:52.320784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:52.452508 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:52.460330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:52.461819 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:52.463026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1f529c04-bb35-406a-9a2d-67ba985699b6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.155424 Jun 15 10:22:52.463589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 568/1119] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:52 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:53.481656 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:53.482291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:53.489137 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.489589 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.490402 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.490881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.623010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:53.630949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:53.632474 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:53.633676 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9fa8207d-2e45-4f9b-9fde-28575e3cf3a1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.155890 Jun 15 10:22:53.634239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 552/1120] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:53 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:54.652539 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:54.653157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:54.659899 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:54.660357 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:54.661124 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:54.661566 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:54.794363 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:54.802836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:54.804354 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:54.805515 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-798b02f4-e288-411f-9f53-67fddf62cea6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.156928 Jun 15 10:22:54.806083 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 569/1121] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:54 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:55.823468 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:55.824073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:55.830503 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:55.830953 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:55.831707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:55.832136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:55.961548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:55.970307 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:55.971797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:55.972942 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-28c2c580-670d-44e1-9e3d-177ffa68c471 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.153382 Jun 15 10:22:55.973504 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 553/1122] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:55 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:56.991127 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:56.991741 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:56.999119 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:56.999770 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.000163 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.000607 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.130832 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:57.139100 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:57.140632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:57.141797 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c47a69b8-5ef5-4915-b88e-9ec34274d33a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.154596 Jun 15 10:22:57.142579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 570/1123] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:56 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:57.428910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bc92edd4-c675-4fbb-943d-857f7b8547de tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:57.429917 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bc92edd4-c675-4fbb-943d-857f7b8547de tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:57.437239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc92edd4-c675-4fbb-943d-857f7b8547de tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.437686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc92edd4-c675-4fbb-943d-857f7b8547de tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.438476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc92edd4-c675-4fbb-943d-857f7b8547de tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.438913 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bc92edd4-c675-4fbb-943d-857f7b8547de tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.466341 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bc92edd4-c675-4fbb-943d-857f7b8547de tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041332 Jun 15 10:22:57.467135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 554/1124] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:22:57 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:22:57.523602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7cf1c6c0-ce1e-4737-8426-3896be5079f6 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:57.524108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7cf1c6c0-ce1e-4737-8426-3896be5079f6 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:57.530100 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7cf1c6c0-ce1e-4737-8426-3896be5079f6 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.530619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7cf1c6c0-ce1e-4737-8426-3896be5079f6 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.531390 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7cf1c6c0-ce1e-4737-8426-3896be5079f6 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.531831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7cf1c6c0-ce1e-4737-8426-3896be5079f6 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.558880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7cf1c6c0-ce1e-4737-8426-3896be5079f6 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:22:57.634980 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7cf1c6c0-ce1e-4737-8426-3896be5079f6 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 204 len: 0 microversion: 2.1 time: 0.114873 Jun 15 10:22:57.635583 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 571/1125] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:22:57 2022] DELETE /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:22:57.646602 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e61782a0-7c65-44eb-abd3-75f2a4853d01 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:57.647484 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e61782a0-7c65-44eb-abd3-75f2a4853d01 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:57.653970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e61782a0-7c65-44eb-abd3-75f2a4853d01 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.654537 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e61782a0-7c65-44eb-abd3-75f2a4853d01 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.655399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e61782a0-7c65-44eb-abd3-75f2a4853d01 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.655844 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e61782a0-7c65-44eb-abd3-75f2a4853d01 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.789066 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e61782a0-7c65-44eb-abd3-75f2a4853d01 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:57.796909 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e61782a0-7c65-44eb-abd3-75f2a4853d01 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1672 microversion: 2.1 time: 0.156296 Jun 15 10:22:57.797483 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 555/1126] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:57 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:58.160655 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:58.161349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:58.167837 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.168287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.169038 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.169472 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.296137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.303923 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.305412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.306591 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0199d5f4-e87f-44d2-8a35-1d1a967669d8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.150211 Jun 15 10:22:58.307157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 572/1127] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:58 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:58.814006 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0c7c66dd-3b59-4799-9a29-117e8cc74e38 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:58.814651 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0c7c66dd-3b59-4799-9a29-117e8cc74e38 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:58.821104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c7c66dd-3b59-4799-9a29-117e8cc74e38 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.821548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c7c66dd-3b59-4799-9a29-117e8cc74e38 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.822329 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c7c66dd-3b59-4799-9a29-117e8cc74e38 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.822762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0c7c66dd-3b59-4799-9a29-117e8cc74e38 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.957193 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0c7c66dd-3b59-4799-9a29-117e8cc74e38 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.964810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0c7c66dd-3b59-4799-9a29-117e8cc74e38 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1672 microversion: 2.1 time: 0.154681 Jun 15 10:22:58.965498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 556/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:58 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:59.323983 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:59.324615 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:59.331789 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:59.332242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:59.332992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:59.333426 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:59.487980 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:59.496119 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:59.497657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:59.499723 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e14f6ee1-ab2b-4666-94c3-799842995fdc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.179660 Jun 15 10:22:59.500282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 573/1129] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:59 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:59.983719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1e1025bd-0c10-4b15-977e-0aed7a485ef1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:59.984296 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1e1025bd-0c10-4b15-977e-0aed7a485ef1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:59.990740 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1e1025bd-0c10-4b15-977e-0aed7a485ef1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:59.991193 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1e1025bd-0c10-4b15-977e-0aed7a485ef1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:59.991972 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1e1025bd-0c10-4b15-977e-0aed7a485ef1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:59.992411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1e1025bd-0c10-4b15-977e-0aed7a485ef1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:00.085262 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1e1025bd-0c10-4b15-977e-0aed7a485ef1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:00.094495 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1e1025bd-0c10-4b15-977e-0aed7a485ef1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 200 len: 1605 microversion: 2.1 time: 0.113958 Jun 15 10:23:00.095226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 557/1130] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:59 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 1605 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:00.357782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-e5ba3462-a65a-4b48-899f-7af9ddc9de9d req-7083555c-0cd3-480c-beec-85816302168b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7367c589-27eb-4ff0-860e-d6a676c70441", "name": "network-vif-deleted", "tag": "6cc52a64-257c-4283-a225-228e89ddcdf0"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:00.367879 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-e5ba3462-a65a-4b48-899f-7af9ddc9de9d req-7083555c-0cd3-480c-beec-85816302168b service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:00.368326 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-e5ba3462-a65a-4b48-899f-7af9ddc9de9d req-7083555c-0cd3-480c-beec-85816302168b service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:00.380184 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-e5ba3462-a65a-4b48-899f-7af9ddc9de9d req-7083555c-0cd3-480c-beec-85816302168b service nova] Creating event network-vif-deleted:6cc52a64-257c-4283-a225-228e89ddcdf0 for instance 7367c589-27eb-4ff0-860e-d6a676c70441 on hv-cinder-83028 Jun 15 10:23:00.385249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-e5ba3462-a65a-4b48-899f-7af9ddc9de9d req-7083555c-0cd3-480c-beec-85816302168b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031966 Jun 15 10:23:00.386431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 574/1131] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:00.517819 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:00.518910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:00.527905 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:00.528390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:00.530406 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:00.530857 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:00.675472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:00.683324 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:00.684860 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:00.686725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6ebadb1b-27eb-4f8f-9de4-058733eb89cc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.173569 Jun 15 10:23:00.687363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 558/1132] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:00 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:01.113465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:01.114393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:01.121058 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:01.121603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.122495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:01.123646 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.137720 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] HTTP exception thrown: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Request method failure captured: Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 HTTP/1.1 Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbFGODjpC2ugniq1XIB7CYnjt4TP76OBs5BeVEicAufM5sEQjGc6sS3wlxOf42D8QqI2YqND43ywc_6aG5wFqu17AshexrZdU09ZL9-z-hZknUuIW-q1GKEg_QG__08O5mktp1s6C2RK1HoYr6hEPkexL0s_7ZlCx9AXsW4Bb9BH1vI Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:23:01.140633 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36b6b134fac8433db72a937ba72e8a6c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: a04041aca6d64274b7019fcd6ece608c Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:23:01.142349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '7367c589-27eb-4ff0-860e-d6a676c70441'} Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:01.143306 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:23:01.145064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:23:01.146852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Returning 404 to user: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:01.146852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c8f568a2-cd5f-494b-8475-3ff9115cd64b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 404 len: 111 microversion: 2.1 time: 0.033161 Jun 15 10:23:01.146852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 575/1133] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:01 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:23:01.152250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-673a5466-f4fd-49b0-8bfa-131659401277 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '.version_select at 0x7fe25617f310>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:01.172365 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-673a5466-f4fd-49b0-8bfa-131659401277 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483562710" status: 202 len: 0 microversion: 2.1 time: 0.024050 Jun 15 10:23:01.172962 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 559/1134] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 10:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483562710 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:23:01.705624 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:01.706242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:01.712665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:01.713122 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.713909 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:01.714379 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.751672 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bedd67ce-bff0-42a5-b926-51b675eb3541 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1335939552"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:01.752299 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bedd67ce-bff0-42a5-b926-51b675eb3541 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:01.765094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bedd67ce-bff0-42a5-b926-51b675eb3541 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:01.765932 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bedd67ce-bff0-42a5-b926-51b675eb3541 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.766908 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bedd67ce-bff0-42a5-b926-51b675eb3541 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:01.767524 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bedd67ce-bff0-42a5-b926-51b675eb3541 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.953402 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:01.961314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:01.962883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:01.964051 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-19e6c048-cb8e-40ab-8213-f090fb9b294e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.263060 Jun 15 10:23:01.964609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 576/1135] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:01 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:01.969355 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-03876966-9e95-422e-9f2f-1e8908213365 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'create', calling method: .version_select at 0x7fe255ea0e50>, body: {"keypair": {"name": "tempest-keypair-819423793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/EyJkz2yzJageKBqSogP73lRihIKpQ3ISR94aRefBB+yrj4zPClNettPIhwR8YbRaSgZawkRjKYin4qk2JBJ/SAU0n7qjbpraOuRvkY8fS+mbVWLPG475sfuJy0Q3jEw=="}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:01.969714 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.network.security_group_api [None req-bedd67ce-bff0-42a5-b926-51b675eb3541 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Removing security group c02e9d36-1399-4652-bf94-6abd35835dc4 from port 7ed10135-626d-4a21-82fb-bafe20ebc074 Jun 15 10:23:01.983647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-03876966-9e95-422e-9f2f-1e8908213365 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Getting quotas for project 36b6b134fac8433db72a937ba72e8a6c. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:23:01.987531 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-03876966-9e95-422e-9f2f-1e8908213365 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Getting quotas for user a04041aca6d64274b7019fcd6ece608c and project 36b6b134fac8433db72a937ba72e8a6c. Resources: {'key_pairs'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:23:02.011370 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-03876966-9e95-422e-9f2f-1e8908213365 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045688 Jun 15 10:23:02.012410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 577/1136] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:23:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:02.441600 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bedd67ce-bff0-42a5-b926-51b675eb3541 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "POST /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/action" status: 202 len: 0 microversion: 2.1 time: 0.694504 Jun 15 10:23:02.445787 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 560/1137] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Jun 15 10:23:01 2022] POST /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:23:02.458019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-b75274a1-2417-4531-9b0c-ca3803315285 req-14ca425b-671e-4ef2-87c3-9d1f40f72056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f24d77-e20b-448e-aa55-b4aa206c4abf", "tag": "7ed10135-626d-4a21-82fb-bafe20ebc074"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:02.470427 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-b75274a1-2417-4531-9b0c-ca3803315285 req-14ca425b-671e-4ef2-87c3-9d1f40f72056 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.471164 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-b75274a1-2417-4531-9b0c-ca3803315285 req-14ca425b-671e-4ef2-87c3-9d1f40f72056 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:02.488314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-b75274a1-2417-4531-9b0c-ca3803315285 req-14ca425b-671e-4ef2-87c3-9d1f40f72056 service nova] Creating event network-changed:7ed10135-626d-4a21-82fb-bafe20ebc074 for instance 84f24d77-e20b-448e-aa55-b4aa206c4abf on hv-cinder-83028 Jun 15 10:23:02.498830 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-b75274a1-2417-4531-9b0c-ca3803315285 req-14ca425b-671e-4ef2-87c3-9d1f40f72056 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044134 Jun 15 10:23:02.499461 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 578/1138] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:02.982918 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:02.983623 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:02.990074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.990741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:02.991634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.992260 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:03.578454 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:03.602312 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:03.603901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:03.605328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d890fb9c-751b-4c29-b2e7-5b92c444bb82 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.626466 Jun 15 10:23:03.606715 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 561/1139] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:02 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:03.748762 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2060360615", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c016a67-5822-4687-821d-45e29fcf6683"}], "security_groups": [{"name": "tempest-securitygroup--512936622"}], "key_name": "tempest-keypair-819423793", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:03.924619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] validate_networks() for [('4c016a67-5822-4687-821d-45e29fcf6683', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:23:04.566869 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4968594d-3df3-4075-8319-3ea4b993bd24 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:04.567474 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4968594d-3df3-4075-8319-3ea4b993bd24 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:04.574675 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4968594d-3df3-4075-8319-3ea4b993bd24 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.575230 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4968594d-3df3-4075-8319-3ea4b993bd24 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.576886 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4968594d-3df3-4075-8319-3ea4b993bd24 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.577300 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:23:04.577410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4968594d-3df3-4075-8319-3ea4b993bd24 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.577778 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:23:04.578261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:23:04.578697 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:23:04.579272 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:23:04.588247 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.588693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.589517 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.589952 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.606928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Getting quotas for project 36b6b134fac8433db72a937ba72e8a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:23:04.613771 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Getting quotas for user a04041aca6d64274b7019fcd6ece608c and project 36b6b134fac8433db72a937ba72e8a6c. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:23:04.625623 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:23:04.628094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:23:04.665855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-4968594d-3df3-4075-8319-3ea4b993bd24 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lazy-loading 'services' on Instance uuid 84f24d77-e20b-448e-aa55-b4aa206c4abf {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:23:04.680751 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e955728c-fc66-4bd6-83fc-83e61dc35bc5 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.936838 Jun 15 10:23:04.683249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 579/1140] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:23:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:23:04.689434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-18c3b6a0-d793-43d7-a3b5-f270c66a7ee4 req-1dcefa71-0b6c-4350-abac-1b326ff274e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f24d77-e20b-448e-aa55-b4aa206c4abf", "tag": "7ed10135-626d-4a21-82fb-bafe20ebc074"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:04.705487 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-18c3b6a0-d793-43d7-a3b5-f270c66a7ee4 req-1dcefa71-0b6c-4350-abac-1b326ff274e4 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.705926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-18c3b6a0-d793-43d7-a3b5-f270c66a7ee4 req-1dcefa71-0b6c-4350-abac-1b326ff274e4 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.717599 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-18c3b6a0-d793-43d7-a3b5-f270c66a7ee4 req-1dcefa71-0b6c-4350-abac-1b326ff274e4 service nova] Creating event network-changed:7ed10135-626d-4a21-82fb-bafe20ebc074 for instance 84f24d77-e20b-448e-aa55-b4aa206c4abf on hv-cinder-83028 Jun 15 10:23:04.722543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-18c3b6a0-d793-43d7-a3b5-f270c66a7ee4 req-1dcefa71-0b6c-4350-abac-1b326ff274e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037981 Jun 15 10:23:04.723147 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 580/1141] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:04.730985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:04.731695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:04.738653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.739179 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.740013 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.740518 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.790415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4968594d-3df3-4075-8319-3ea4b993bd24 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments/7ac788de-ef9b-4ca6-9c33-e34eae8a7599" status: 202 len: 0 microversion: 2.1 time: 0.227481 Jun 15 10:23:04.796519 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 562/1142] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:23:04 2022] DELETE /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments/7ac788de-ef9b-4ca6-9c33-e34eae8a7599 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:23:04.802376 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-57ccb38f-07df-41d3-a1fc-f511a3b32cf4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:04.803100 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-57ccb38f-07df-41d3-a1fc-f511a3b32cf4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:04.887646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-57ccb38f-07df-41d3-a1fc-f511a3b32cf4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:04.895919 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-57ccb38f-07df-41d3-a1fc-f511a3b32cf4 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1237 microversion: 2.1 time: 0.097852 Jun 15 10:23:04.896448 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 563/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:04 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:04.901666 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-078ea84a-a379-49af-a0b6-20a0403f7044 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:04.902690 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-078ea84a-a379-49af-a0b6-20a0403f7044 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:04.913781 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-078ea84a-a379-49af-a0b6-20a0403f7044 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.914639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-078ea84a-a379-49af-a0b6-20a0403f7044 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.916863 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-078ea84a-a379-49af-a0b6-20a0403f7044 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.917486 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-078ea84a-a379-49af-a0b6-20a0403f7044 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.963507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-078ea84a-a379-49af-a0b6-20a0403f7044 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065560 Jun 15 10:23:04.964102 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 564/1144] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:23:04 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:05.056740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:05.066398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:05.068201 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:05.069712 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c47b558f-1e8e-4db7-a92c-4857a723373c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.342842 Jun 15 10:23:05.070833 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 581/1145] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:04 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:05.915318 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0b622dc1-406b-428d-8650-f832416cd229 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:05.915927 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0b622dc1-406b-428d-8650-f832416cd229 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:05.922443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0b622dc1-406b-428d-8650-f832416cd229 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.922889 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0b622dc1-406b-428d-8650-f832416cd229 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.923652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0b622dc1-406b-428d-8650-f832416cd229 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.924087 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0b622dc1-406b-428d-8650-f832416cd229 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.928152 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:05.977774 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ef64cfe0-0e7d-4565-8ade-72cfcfdbeb38 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:05.979284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ef64cfe0-0e7d-4565-8ade-72cfcfdbeb38 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:05.989016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef64cfe0-0e7d-4565-8ade-72cfcfdbeb38 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.989676 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef64cfe0-0e7d-4565-8ade-72cfcfdbeb38 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.990708 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef64cfe0-0e7d-4565-8ade-72cfcfdbeb38 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.991219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef64cfe0-0e7d-4565-8ade-72cfcfdbeb38 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.993680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0b622dc1-406b-428d-8650-f832416cd229 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:06.003484 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0b622dc1-406b-428d-8650-f832416cd229 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1289 microversion: 2.1 time: 0.092682 Jun 15 10:23:06.004073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 565/1146] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:05 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:06.025866 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ef64cfe0-0e7d-4565-8ade-72cfcfdbeb38 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052629 Jun 15 10:23:06.026458 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 582/1147] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:23:05 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:23:06.088887 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:06.089507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:06.096761 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:06.097223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:06.098011 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:06.098483 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:06.287212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:06.295483 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:06.297014 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:06.298231 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6819d480-f1d2-416c-9f1e-394f43bd197d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1744 microversion: 2.20 time: 0.213630 Jun 15 10:23:06.299136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 566/1148] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:06 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:07.020812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-16a362c1-f7d2-4783-964d-4278d75d33e8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:07.021425 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-16a362c1-f7d2-4783-964d-4278d75d33e8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:07.030916 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-16a362c1-f7d2-4783-964d-4278d75d33e8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.031576 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-16a362c1-f7d2-4783-964d-4278d75d33e8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.032552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-16a362c1-f7d2-4783-964d-4278d75d33e8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.033253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-16a362c1-f7d2-4783-964d-4278d75d33e8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.039136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-afc5c9d2-a9d3-4ee0-895a-4c0219a3d164 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:07.040638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-afc5c9d2-a9d3-4ee0-895a-4c0219a3d164 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:07.048979 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afc5c9d2-a9d3-4ee0-895a-4c0219a3d164 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.049656 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afc5c9d2-a9d3-4ee0-895a-4c0219a3d164 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.050630 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afc5c9d2-a9d3-4ee0-895a-4c0219a3d164 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.051235 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-afc5c9d2-a9d3-4ee0-895a-4c0219a3d164 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.094440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-afc5c9d2-a9d3-4ee0-895a-4c0219a3d164 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059509 Jun 15 10:23:07.095414 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 567/1149] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:23:07 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:23:07.109348 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:07.110057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:07.116749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.117621 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.118340 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.118849 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.218995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] HTTP exception thrown: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf is not attached to volume 7ac788de-ef9b-4ca6-9c33-e34eae8a7599 Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Request method failure captured: Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments/7ac788de-ef9b-4ca6-9c33-e34eae8a7599 HTTP/1.1 Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbHt8xhIBHnby_i-xV32z8M-21XTmGWFOgkB-728LpsruXHZqUxPX1PXo17Fzoo8WtcQdwje7QXdik5kgN7qFeeIpobp0OsjxyoU2MX0tSl039bW_wbAvWWWoUvqVI9d5h4pwqDbhTdwprdDhxVX9vuL-YWL16jTRByrUuXD_YV8d2g Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: d6ff13b44dc940beaa20649cc649b32f Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestMinimumBasicScenario-1730298988 Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:23:07.221443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6ff13b44dc940beaa20649cc649b32f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6ff13b44dc940beaa20649cc649b32f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6ff13b44dc940beaa20649cc649b32f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6ff13b44dc940beaa20649cc649b32f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestMinimumBasicScenario-1730298988 Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: d6ff13b44dc940beaa20649cc649b32f Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1730298988 Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-TestMinimumBasicScenario-1730298988-project Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 07fc13bc9b914ac48cd8aa5e4728f000 Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestMinimumBasicScenario-1730298988-project Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:23:07.222795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf is not attached to volume 7ac788de-ef9b-4ca6-9c33-e34eae8a7599 Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'server_id': '84f24d77-e20b-448e-aa55-b4aa206c4abf', 'id': '7ac788de-ef9b-4ca6-9c33-e34eae8a7599'} Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7ac788de-ef9b-4ca6-9c33-e34eae8a7599. Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:07.223530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf is not attached to volume 7ac788de-ef9b-4ca6-9c33-e34eae8a7599 Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf is not attached to volume 7ac788de-ef9b-4ca6-9c33-e34eae8a7599 Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:07.225187 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Returning 404 to user: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf is not attached to volume 7ac788de-ef9b-4ca6-9c33-e34eae8a7599 {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:07.226092 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-16a362c1-f7d2-4783-964d-4278d75d33e8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:07.226390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c82c1ae5-f116-4b77-9c8b-cc2e0a3467e6 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments/7ac788de-ef9b-4ca6-9c33-e34eae8a7599" status: 404 len: 154 microversion: 2.1 time: 0.120851 Jun 15 10:23:07.226390 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 568/1150] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:23:07 2022] DELETE /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf/os-volume_attachments/7ac788de-ef9b-4ca6-9c33-e34eae8a7599 => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:23:07.237671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-16a362c1-f7d2-4783-964d-4278d75d33e8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.220852 Jun 15 10:23:07.238569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 583/1151] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:07 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:07.317477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:07.318400 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:07.325070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.326619 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.327750 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.328195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.473360 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:07.481934 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:07.485504 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:07.485504 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1b370d45-1646-4451-8138-42084d81a35e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1744 microversion: 2.20 time: 0.171949 Jun 15 10:23:07.485938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 569/1152] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:07 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:07.806235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-67e4959a-ba1b-4331-898d-7158dee49d20 req-a042e96b-ba1c-4245-a329-ec7c30a84202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4b1e80-69d7-45d7-8f5c-875bfc36c14a", "tag": "ce351867-bf25-4b16-bacb-b029aee23d0f"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:07.821438 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-67e4959a-ba1b-4331-898d-7158dee49d20 req-a042e96b-ba1c-4245-a329-ec7c30a84202 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.821887 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-67e4959a-ba1b-4331-898d-7158dee49d20 req-a042e96b-ba1c-4245-a329-ec7c30a84202 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.834741 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-67e4959a-ba1b-4331-898d-7158dee49d20 req-a042e96b-ba1c-4245-a329-ec7c30a84202 service nova] Creating event network-changed:ce351867-bf25-4b16-bacb-b029aee23d0f for instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a on hv-cinder-83028 Jun 15 10:23:07.839886 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-67e4959a-ba1b-4331-898d-7158dee49d20 req-a042e96b-ba1c-4245-a329-ec7c30a84202 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046355 Jun 15 10:23:07.840573 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 584/1153] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:08.255523 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dc0c744e-9b62-4f65-8b51-610eb6bb7703 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:08.256491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dc0c744e-9b62-4f65-8b51-610eb6bb7703 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:08.263563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dc0c744e-9b62-4f65-8b51-610eb6bb7703 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.264047 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dc0c744e-9b62-4f65-8b51-610eb6bb7703 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.264898 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dc0c744e-9b62-4f65-8b51-610eb6bb7703 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.265411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dc0c744e-9b62-4f65-8b51-610eb6bb7703 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.379089 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ef20aafa-dc5f-4881-851a-2a9070ae579b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:08.379680 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ef20aafa-dc5f-4881-851a-2a9070ae579b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:08.387180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef20aafa-dc5f-4881-851a-2a9070ae579b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.387906 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef20aafa-dc5f-4881-851a-2a9070ae579b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.388777 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef20aafa-dc5f-4881-851a-2a9070ae579b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.389225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ef20aafa-dc5f-4881-851a-2a9070ae579b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.393498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:08.400374 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dc0c744e-9b62-4f65-8b51-610eb6bb7703 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:08.409150 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dc0c744e-9b62-4f65-8b51-610eb6bb7703 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.157484 Jun 15 10:23:08.409721 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 570/1154] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:08 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:08.416429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ef20aafa-dc5f-4881-851a-2a9070ae579b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:23:08.489961 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ef20aafa-dc5f-4881-851a-2a9070ae579b tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "DELETE /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 204 len: 0 microversion: 2.1 time: 0.115224 Jun 15 10:23:08.490493 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 585/1155] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:23:08 2022] DELETE /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:23:08.499287 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f4a407d8-365f-42be-bb57-73c5b2880ff2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:08.499900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f4a407d8-365f-42be-bb57-73c5b2880ff2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:08.503604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:08.504459 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:08.506090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4a407d8-365f-42be-bb57-73c5b2880ff2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.506449 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4a407d8-365f-42be-bb57-73c5b2880ff2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.507450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4a407d8-365f-42be-bb57-73c5b2880ff2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.507652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f4a407d8-365f-42be-bb57-73c5b2880ff2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.510509 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.510966 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.511737 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.512179 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.709423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f4a407d8-365f-42be-bb57-73c5b2880ff2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:08.713691 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:08.718008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f4a407d8-365f-42be-bb57-73c5b2880ff2 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1553 microversion: 2.1 time: 0.223115 Jun 15 10:23:08.719012 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 571/1156] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:08 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:08.724831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:08.728007 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:08.729725 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2e80b75a-b19e-4efc-89f3-2e6a6a206040 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1744 microversion: 2.20 time: 0.229841 Jun 15 10:23:08.730403 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 586/1157] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:08 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1744 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:23:09.426180 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0e0fe3ba-2cfd-4831-967f-5d526cc4cc9e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:09.426829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0e0fe3ba-2cfd-4831-967f-5d526cc4cc9e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:09.433429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0e0fe3ba-2cfd-4831-967f-5d526cc4cc9e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.433880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0e0fe3ba-2cfd-4831-967f-5d526cc4cc9e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.434707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0e0fe3ba-2cfd-4831-967f-5d526cc4cc9e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.435517 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0e0fe3ba-2cfd-4831-967f-5d526cc4cc9e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.573407 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0e0fe3ba-2cfd-4831-967f-5d526cc4cc9e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:09.581484 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0e0fe3ba-2cfd-4831-967f-5d526cc4cc9e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.159245 Jun 15 10:23:09.582053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 572/1158] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:09 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:09.737915 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b4c70101-3356-4c10-881c-7d2f007317c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:09.738791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b4c70101-3356-4c10-881c-7d2f007317c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:09.745567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b4c70101-3356-4c10-881c-7d2f007317c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.746115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b4c70101-3356-4c10-881c-7d2f007317c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.746920 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b4c70101-3356-4c10-881c-7d2f007317c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.748277 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b4c70101-3356-4c10-881c-7d2f007317c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.748420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:09.748595 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:09.754539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.754990 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.755745 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.756179 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.943598 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b4c70101-3356-4c10-881c-7d2f007317c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:09.946758 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:09.952137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b4c70101-3356-4c10-881c-7d2f007317c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1553 microversion: 2.1 time: 0.219855 Jun 15 10:23:09.952822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 587/1159] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:09 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:09.956219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:09.957795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:09.958995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-861e0dbb-4335-4dd8-a7c3-ba152dd01d86 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1744 microversion: 2.20 time: 0.215322 Jun 15 10:23:09.959544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 573/1160] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:09 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:23:10.214465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-ee998cdd-a21e-4ce9-ac62-18cb4f6f70b7 req-b978a9ec-9bd1-483b-8d91-34bdfec9d954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3", "name": "network-vif-plugged", "status": "completed", "tag": "132b131d-7c10-4f96-96c1-cc640e8d71a7"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:10.223307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-ee998cdd-a21e-4ce9-ac62-18cb4f6f70b7 req-b978a9ec-9bd1-483b-8d91-34bdfec9d954 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.223820 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-ee998cdd-a21e-4ce9-ac62-18cb4f6f70b7 req-b978a9ec-9bd1-483b-8d91-34bdfec9d954 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.236639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-ee998cdd-a21e-4ce9-ac62-18cb4f6f70b7 req-b978a9ec-9bd1-483b-8d91-34bdfec9d954 service nova] Creating event network-vif-plugged:132b131d-7c10-4f96-96c1-cc640e8d71a7 for instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 on hv-cinder-83028 Jun 15 10:23:10.241530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-ee998cdd-a21e-4ce9-ac62-18cb4f6f70b7 req-b978a9ec-9bd1-483b-8d91-34bdfec9d954 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031069 Jun 15 10:23:10.242119 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 588/1161] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:10.598064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d7583442-34b4-4dcd-853b-b0ab249c5659 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:10.598719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d7583442-34b4-4dcd-853b-b0ab249c5659 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:10.605232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7583442-34b4-4dcd-853b-b0ab249c5659 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.605683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7583442-34b4-4dcd-853b-b0ab249c5659 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.606479 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7583442-34b4-4dcd-853b-b0ab249c5659 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.606951 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d7583442-34b4-4dcd-853b-b0ab249c5659 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.735376 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d7583442-34b4-4dcd-853b-b0ab249c5659 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:10.742709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d7583442-34b4-4dcd-853b-b0ab249c5659 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.148445 Jun 15 10:23:10.743279 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 574/1162] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:10 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:10.970791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c4610289-bba9-4f51-8fea-a41c9c14bb22 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:10.971509 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c4610289-bba9-4f51-8fea-a41c9c14bb22 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:10.976666 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:10.977306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:10.978406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4610289-bba9-4f51-8fea-a41c9c14bb22 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.978865 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4610289-bba9-4f51-8fea-a41c9c14bb22 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.979637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4610289-bba9-4f51-8fea-a41c9c14bb22 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.980103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4610289-bba9-4f51-8fea-a41c9c14bb22 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.983894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.984347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.985110 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.985551 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.173511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c4610289-bba9-4f51-8fea-a41c9c14bb22 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:11.180092 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:11.181267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c4610289-bba9-4f51-8fea-a41c9c14bb22 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1553 microversion: 2.1 time: 0.215912 Jun 15 10:23:11.181849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 589/1163] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:10 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:11.188490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:11.190090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:11.191291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-318759f4-88b4-4731-8374-00275c035a8c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1744 microversion: 2.20 time: 0.218482 Jun 15 10:23:11.191846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 575/1164] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:10 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:23:11.760537 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dc7734bf-5435-42f4-9437-57c7cd570f3d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:11.761144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dc7734bf-5435-42f4-9437-57c7cd570f3d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:11.767332 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc7734bf-5435-42f4-9437-57c7cd570f3d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.767790 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc7734bf-5435-42f4-9437-57c7cd570f3d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.768586 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc7734bf-5435-42f4-9437-57c7cd570f3d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.769030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc7734bf-5435-42f4-9437-57c7cd570f3d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.898582 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dc7734bf-5435-42f4-9437-57c7cd570f3d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:11.905902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dc7734bf-5435-42f4-9437-57c7cd570f3d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.149405 Jun 15 10:23:11.906507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 590/1165] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:11 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:12.198817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e317fb82-cda2-4989-b41b-c2a92b7db9c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:12.199464 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e317fb82-cda2-4989-b41b-c2a92b7db9c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:12.206624 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e317fb82-cda2-4989-b41b-c2a92b7db9c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:12.207105 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e317fb82-cda2-4989-b41b-c2a92b7db9c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:12.207932 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e317fb82-cda2-4989-b41b-c2a92b7db9c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:12.208371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e317fb82-cda2-4989-b41b-c2a92b7db9c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:12.209686 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:12.210326 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:12.217482 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:12.217944 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:12.218742 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:12.219184 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:12.406797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e317fb82-cda2-4989-b41b-c2a92b7db9c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:12.414058 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:12.414355 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e317fb82-cda2-4989-b41b-c2a92b7db9c7 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1553 microversion: 2.1 time: 0.219607 Jun 15 10:23:12.414929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 576/1166] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:12 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:12.422411 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:12.423928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:12.425076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-16292d19-2a02-420b-a30c-5209cd951677 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1744 microversion: 2.20 time: 0.219245 Jun 15 10:23:12.425619 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 591/1167] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:12 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:23:12.923662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3be6c38f-a890-4c5b-8a5c-0c522f2bf8aa tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:12.924300 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3be6c38f-a890-4c5b-8a5c-0c522f2bf8aa tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:12.930571 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3be6c38f-a890-4c5b-8a5c-0c522f2bf8aa tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:12.931024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3be6c38f-a890-4c5b-8a5c-0c522f2bf8aa tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:12.931794 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3be6c38f-a890-4c5b-8a5c-0c522f2bf8aa tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:12.932232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3be6c38f-a890-4c5b-8a5c-0c522f2bf8aa tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:13.064000 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3be6c38f-a890-4c5b-8a5c-0c522f2bf8aa tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:13.071394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3be6c38f-a890-4c5b-8a5c-0c522f2bf8aa tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.152286 Jun 15 10:23:13.071961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 577/1168] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:12 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:13.432028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2598d234-fc77-4411-bda6-5a65a9084b79 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:13.432654 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2598d234-fc77-4411-bda6-5a65a9084b79 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:13.439736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2598d234-fc77-4411-bda6-5a65a9084b79 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:13.440259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2598d234-fc77-4411-bda6-5a65a9084b79 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:13.440960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2598d234-fc77-4411-bda6-5a65a9084b79 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:13.441400 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2598d234-fc77-4411-bda6-5a65a9084b79 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:13.443949 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:13.444848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:13.451065 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:13.451518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:13.453562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:13.454015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:13.644756 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2598d234-fc77-4411-bda6-5a65a9084b79 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:13.651315 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:13.652507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2598d234-fc77-4411-bda6-5a65a9084b79 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1553 microversion: 2.1 time: 0.224467 Jun 15 10:23:13.653098 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 592/1169] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:13 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:13.659581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:13.661094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:13.662259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ea1ddb28-22a1-460c-a221-aa32890a9375 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1744 microversion: 2.20 time: 0.222231 Jun 15 10:23:13.662838 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 578/1170] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:13 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:23:14.088588 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0b7adbef-1747-4d38-8250-e23e7e67de61 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:14.089203 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0b7adbef-1747-4d38-8250-e23e7e67de61 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:14.095708 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b7adbef-1747-4d38-8250-e23e7e67de61 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.096035 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b7adbef-1747-4d38-8250-e23e7e67de61 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.096856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b7adbef-1747-4d38-8250-e23e7e67de61 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.097244 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0b7adbef-1747-4d38-8250-e23e7e67de61 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.237230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-0b7adbef-1747-4d38-8250-e23e7e67de61 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:14.244852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0b7adbef-1747-4d38-8250-e23e7e67de61 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.160201 Jun 15 10:23:14.245623 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 593/1171] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:14 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:14.473701 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-0ff995da-7158-418e-967f-c18f7714b025 req-2bdae6b9-09a9-4dcf-824b-219f7d95f18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f24d77-e20b-448e-aa55-b4aa206c4abf", "name": "network-vif-deleted", "tag": "7ed10135-626d-4a21-82fb-bafe20ebc074"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:14.484089 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-0ff995da-7158-418e-967f-c18f7714b025 req-2bdae6b9-09a9-4dcf-824b-219f7d95f18d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.484535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-0ff995da-7158-418e-967f-c18f7714b025 req-2bdae6b9-09a9-4dcf-824b-219f7d95f18d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.495656 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-0ff995da-7158-418e-967f-c18f7714b025 req-2bdae6b9-09a9-4dcf-824b-219f7d95f18d service nova] Creating event network-vif-deleted:7ed10135-626d-4a21-82fb-bafe20ebc074 for instance 84f24d77-e20b-448e-aa55-b4aa206c4abf on hv-cinder-83028 Jun 15 10:23:14.500708 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-0ff995da-7158-418e-967f-c18f7714b025 req-2bdae6b9-09a9-4dcf-824b-219f7d95f18d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 Jun 15 10:23:14.501478 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 579/1172] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:14.670043 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:14.671057 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:14.675179 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:14.676152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=10 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:14.680172 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.680926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.681975 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.682574 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.685422 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:14.686183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:14.694845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.695301 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.696081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.696522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.712658 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:14.719476 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.719922 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.720373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lazy-loading 'fault' on Instance uuid 84f24d77-e20b-448e-aa55-b4aa206c4abf {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:23:14.786731 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07fc13bc9b914ac48cd8aa5e4728f000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ff13b44dc940beaa20649cc649b32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:14.794565 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7c84c07c-3d7f-4961-8537-7fc68f66a3e5 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 200 len: 1347 microversion: 2.1 time: 0.128206 Jun 15 10:23:14.795152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 594/1173] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:14 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 1347 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:14.897241 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:15.118447 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:15.129636 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:15.131189 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:15.132377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4aa92c3f-b677-41b2-a214-2afb9413d263 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1744 microversion: 2.20 time: 0.454732 Jun 15 10:23:15.132961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 580/1174] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:14 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1744 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:15.261113 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-42674d62-5189-4d5d-9b70-44368924b334 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:15.261653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-42674d62-5189-4d5d-9b70-44368924b334 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:15.268354 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-42674d62-5189-4d5d-9b70-44368924b334 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:15.268815 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-42674d62-5189-4d5d-9b70-44368924b334 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:15.269575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-42674d62-5189-4d5d-9b70-44368924b334 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:15.270044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-42674d62-5189-4d5d-9b70-44368924b334 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:15.400511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-42674d62-5189-4d5d-9b70-44368924b334 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:15.407961 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-42674d62-5189-4d5d-9b70-44368924b334 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.150907 Jun 15 10:23:15.408532 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 595/1175] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:15 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:15.812115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:15.812643 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] [instance: 84f24d77-e20b-448e-aa55-b4aa206c4abf] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:15.819070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:15.819522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:15.820297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:15.820737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:15.836519 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] HTTP exception thrown: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf could not be found. Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Request method failure captured: Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf HTTP/1.1 Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbHt8xhIBHnby_i-xV32z8M-21XTmGWFOgkB-728LpsruXHZqUxPX1PXo17Fzoo8WtcQdwje7QXdik5kgN7qFeeIpobp0OsjxyoU2MX0tSl039bW_wbAvWWWoUvqVI9d5h4pwqDbhTdwprdDhxVX9vuL-YWL16jTRByrUuXD_YV8d2g Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: d6ff13b44dc940beaa20649cc649b32f Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestMinimumBasicScenario-1730298988 Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:23:15.838188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6ff13b44dc940beaa20649cc649b32f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6ff13b44dc940beaa20649cc649b32f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6ff13b44dc940beaa20649cc649b32f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6ff13b44dc940beaa20649cc649b32f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestMinimumBasicScenario-1730298988 Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: d6ff13b44dc940beaa20649cc649b32f Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1730298988 Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-TestMinimumBasicScenario-1730298988-project Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 07fc13bc9b914ac48cd8aa5e4728f000 Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestMinimumBasicScenario-1730298988-project Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf could not be found. Jun 15 10:23:15.839572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '84f24d77-e20b-448e-aa55-b4aa206c4abf'} Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf could not be found. Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:15.840297 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf could not be found. Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf could not be found. Jun 15 10:23:15.841785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:15.843989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Returning 404 to user: Instance 84f24d77-e20b-448e-aa55-b4aa206c4abf could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:15.843989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c9a62fbb-3a54-440e-8bce-7d6dc6087965 tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf" status: 404 len: 111 microversion: 2.1 time: 0.031569 Jun 15 10:23:15.843989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 581/1176] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:15 2022] GET /compute/v2.1/servers/84f24d77-e20b-448e-aa55-b4aa206c4abf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:23:15.849355 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b67fe3d9-4030-475a-99cf-53332622c97e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] Calling method '.version_select at 0x7fe256142d30>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:15.868442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b67fe3d9-4030-475a-99cf-53332622c97e tempest-TestMinimumBasicScenario-1730298988 tempest-TestMinimumBasicScenario-1730298988-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-60298543" status: 202 len: 0 microversion: 2.1 time: 0.022784 Jun 15 10:23:15.869080 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 596/1177] 10.222.0.57 () {58 vars in 1265 bytes} [Wed Jun 15 10:23:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-60298543 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:23:16.151539 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:16.152435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:16.162754 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.163519 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.164467 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.165117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.376578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:16.387696 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:16.389873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:16.390957 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-bf2653d3-557d-4928-aaea-cb001994e07c req-0114363d-6088-400a-ab46-64b5dee7ffe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4b1e80-69d7-45d7-8f5c-875bfc36c14a", "name": "network-vif-plugged", "status": "completed", "tag": "ce351867-bf25-4b16-bacb-b029aee23d0f"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:16.392402 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f0a80fe7-4ca7-458b-978e-c5f3ff86a0b1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.245057 Jun 15 10:23:16.393409 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 582/1178] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:16 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:16.417550 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-bf2653d3-557d-4928-aaea-cb001994e07c req-0114363d-6088-400a-ab46-64b5dee7ffe7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.418004 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-bf2653d3-557d-4928-aaea-cb001994e07c req-0114363d-6088-400a-ab46-64b5dee7ffe7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.430080 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-bf2653d3-557d-4928-aaea-cb001994e07c req-0114363d-6088-400a-ab46-64b5dee7ffe7 service nova] Creating event network-vif-plugged:ce351867-bf25-4b16-bacb-b029aee23d0f for instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a on hv-cinder-83028 Jun 15 10:23:16.431028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-dd6a232f-71f8-4802-9e65-c97c566d2b30 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:16.431671 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-dd6a232f-71f8-4802-9e65-c97c566d2b30 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:16.435477 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-bf2653d3-557d-4928-aaea-cb001994e07c req-0114363d-6088-400a-ab46-64b5dee7ffe7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049316 Jun 15 10:23:16.437152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 597/1179] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:16.451159 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dd6a232f-71f8-4802-9e65-c97c566d2b30 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.451661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dd6a232f-71f8-4802-9e65-c97c566d2b30 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.452998 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dd6a232f-71f8-4802-9e65-c97c566d2b30 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.453440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-dd6a232f-71f8-4802-9e65-c97c566d2b30 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.462250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:16.662240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-dd6a232f-71f8-4802-9e65-c97c566d2b30 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:16.682050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-dd6a232f-71f8-4802-9e65-c97c566d2b30 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.260093 Jun 15 10:23:16.683894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 583/1180] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:16 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:17.412508 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:17.414165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:17.421524 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.422095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:17.423019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.423721 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:17.582962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:17.592000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:17.593967 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:17.595456 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f994eb28-1360-4f41-a8c0-9d9f5a928d1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.188228 Jun 15 10:23:17.605928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 598/1181] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:17 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:17.700800 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e3f7a1ec-15a1-459e-b4f7-6e523b1d167c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:17.702332 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e3f7a1ec-15a1-459e-b4f7-6e523b1d167c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:17.705658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:17.712792 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3f7a1ec-15a1-459e-b4f7-6e523b1d167c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.713752 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3f7a1ec-15a1-459e-b4f7-6e523b1d167c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:17.714811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3f7a1ec-15a1-459e-b4f7-6e523b1d167c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.715491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e3f7a1ec-15a1-459e-b4f7-6e523b1d167c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:17.867344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-e3f7a1ec-15a1-459e-b4f7-6e523b1d167c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:17.877015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e3f7a1ec-15a1-459e-b4f7-6e523b1d167c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.180054 Jun 15 10:23:17.886788 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 584/1182] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:17 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:18.614729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:18.616408 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:18.625527 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:18.626564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:18.628674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:18.629284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:18.943499 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5785c01f-058e-4700-99c3-5187d2743095 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:18.944781 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5785c01f-058e-4700-99c3-5187d2743095 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:18.956351 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5785c01f-058e-4700-99c3-5187d2743095 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:18.957108 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5785c01f-058e-4700-99c3-5187d2743095 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:18.958102 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5785c01f-058e-4700-99c3-5187d2743095 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:18.966252 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5785c01f-058e-4700-99c3-5187d2743095 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:18.981262 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:19.029947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:19.039019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:19.041960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7940cd90-49fa-44e9-8953-de2ed9a0178b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.432243 Jun 15 10:23:19.062695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 599/1183] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:18 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:19.411724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5785c01f-058e-4700-99c3-5187d2743095 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:19.425167 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5785c01f-058e-4700-99c3-5187d2743095 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1362 microversion: 2.1 time: 0.483522 Jun 15 10:23:19.426596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 585/1184] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:18 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:20.063879 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:20.066325 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:20.076418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.077809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.078833 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.079436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.266605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:20.278575 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:20.282940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:20.284367 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-69747f2f-4f40-4432-87c3-693982d0cc50 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.224965 Jun 15 10:23:20.286629 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 600/1185] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:20 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:20.448101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d83f14d0-ee2b-433b-b75a-19f593ad632d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:20.448718 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d83f14d0-ee2b-433b-b75a-19f593ad632d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:20.462469 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d83f14d0-ee2b-433b-b75a-19f593ad632d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.462852 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d83f14d0-ee2b-433b-b75a-19f593ad632d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.464149 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d83f14d0-ee2b-433b-b75a-19f593ad632d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.464773 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d83f14d0-ee2b-433b-b75a-19f593ad632d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.730069 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d83f14d0-ee2b-433b-b75a-19f593ad632d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:20.742692 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d83f14d0-ee2b-433b-b75a-19f593ad632d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1548 microversion: 2.1 time: 0.297988 Jun 15 10:23:20.744327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 586/1186] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:20 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1548 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:20.762785 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a6ab7645-b14e-4b5f-a646-b102f6260ac7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:20.763284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a6ab7645-b14e-4b5f-a646-b102f6260ac7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:20.776065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a6ab7645-b14e-4b5f-a646-b102f6260ac7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.776950 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a6ab7645-b14e-4b5f-a646-b102f6260ac7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.777918 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a6ab7645-b14e-4b5f-a646-b102f6260ac7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.778577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a6ab7645-b14e-4b5f-a646-b102f6260ac7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.911385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a6ab7645-b14e-4b5f-a646-b102f6260ac7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153014 Jun 15 10:23:20.912300 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 601/1187] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 10:23:20 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:21.306291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:21.306930 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:21.318323 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:21.318839 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:21.319603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:21.322045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:21.670309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:21.692582 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:21.697502 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:21.699054 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-12382a61-4459-4fc1-865c-ccd95e611184 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.399472 Jun 15 10:23:21.701726 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 587/1188] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:21 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:22.398418 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-7391f927-3f53-405a-a73e-1eb730edb212 req-8874f939-5904-4f15-a5ff-77317b482074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4b1e80-69d7-45d7-8f5c-875bfc36c14a", "tag": "ce351867-bf25-4b16-bacb-b029aee23d0f"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:22.415012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-7391f927-3f53-405a-a73e-1eb730edb212 req-8874f939-5904-4f15-a5ff-77317b482074 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:22.415679 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-7391f927-3f53-405a-a73e-1eb730edb212 req-8874f939-5904-4f15-a5ff-77317b482074 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:22.441735 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-7391f927-3f53-405a-a73e-1eb730edb212 req-8874f939-5904-4f15-a5ff-77317b482074 service nova] Creating event network-changed:ce351867-bf25-4b16-bacb-b029aee23d0f for instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a on hv-cinder-83028 Jun 15 10:23:22.446899 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-7391f927-3f53-405a-a73e-1eb730edb212 req-8874f939-5904-4f15-a5ff-77317b482074 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053995 Jun 15 10:23:22.447948 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 602/1189] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:22.718623 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:22.719214 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:22.732596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:22.733047 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:22.734020 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:22.734492 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:23.340330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:23.354480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:23.356001 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:23.357175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-223d4baf-773b-44ef-8825-a4b487676627 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.643115 Jun 15 10:23:23.370245 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 588/1190] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:22 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:24.376944 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:24.377655 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:24.384157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:24.385025 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:24.385812 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:24.386259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:24.391517 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:24.542763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:24.553850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:24.555414 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:24.556617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6408563c-679c-4633-8519-292dc29fa1a4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.184525 Jun 15 10:23:24.557205 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 603/1191] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:24 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:25.576830 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:25.578455 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:25.592723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:25.593521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:25.594580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:25.597417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:25.818837 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:25.837227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:25.839658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:25.840894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1fd31f46-0ac3-47f6-82de-dbd0cf0b2a23 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.268078 Jun 15 10:23:25.841877 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 589/1192] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:25 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:26.863159 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:26.863775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:26.870780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:26.871231 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:26.872000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:26.872435 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:27.482751 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:27.492317 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:27.493887 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:27.495246 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9bd3191a-492e-4053-be09-c835e80900fe tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.637779 Jun 15 10:23:27.496047 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 604/1193] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:26 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:28.515156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:28.515773 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:28.522322 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:28.522776 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:28.523541 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:28.523981 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:28.711365 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:28.720831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:28.722364 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:28.723518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ac52bcd6-1212-494a-a06c-7dbf27d2414d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1739 microversion: 2.20 time: 0.213042 Jun 15 10:23:28.724072 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 590/1194] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:28 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:29.740862 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:29.741504 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:29.747969 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:29.748416 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:29.749572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:29.749788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:29.883707 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:29.892646 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:29.894083 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:29.895282 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-efe5add6-6e67-4b95-84cf-8d3dbc7c4fd1 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1721 microversion: 2.20 time: 0.158284 Jun 15 10:23:29.895834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 605/1195] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:29 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:30.915064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:30.915793 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:30.922924 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:30.923374 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:30.924133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:30.924604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:31.060358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:31.069010 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:31.070554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:31.071742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0366fb62-003e-42a7-8a12-38e989c42c6c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1721 microversion: 2.20 time: 0.161612 Jun 15 10:23:31.072298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 591/1196] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:30 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:32.090241 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:32.090888 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:32.097738 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.098223 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.099034 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.099479 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.229824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-34d463cd-734b-4d3b-bfb1-7ed314376764 req-66dce516-79e1-44d4-8a06-323acebfcbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3", "name": "network-vif-unplugged", "status": "completed", "tag": "132b131d-7c10-4f96-96c1-cc640e8d71a7"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:32.234992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:32.239999 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-34d463cd-734b-4d3b-bfb1-7ed314376764 req-66dce516-79e1-44d4-8a06-323acebfcbf9 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.240490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-34d463cd-734b-4d3b-bfb1-7ed314376764 req-66dce516-79e1-44d4-8a06-323acebfcbf9 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.244754 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:32.246391 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:32.247606 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e3820c43-80a4-4d7d-8871-e67ba677ebb4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1664 microversion: 2.20 time: 0.161289 Jun 15 10:23:32.248422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 606/1197] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:32 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:32.253012 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.compute.server_external_events [req-34d463cd-734b-4d3b-bfb1-7ed314376764 req-66dce516-79e1-44d4-8a06-323acebfcbf9 service nova] Unable to find a host for instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3. Dropping event network-vif-unplugged {{(pid=117721) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 10:23:32.253898 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-34d463cd-734b-4d3b-bfb1-7ed314376764 req-66dce516-79e1-44d4-8a06-323acebfcbf9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028034 Jun 15 10:23:32.254656 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 592/1198] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 15 10:23:32.266111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a7c6f6bf-9546-4ea4-a9dd-f79b087e2e1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72dcfe4a-c805-4923-b34c-19779358af7c"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:32.267252 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a7c6f6bf-9546-4ea4-a9dd-f79b087e2e1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:32.273204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a7c6f6bf-9546-4ea4-a9dd-f79b087e2e1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.273662 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a7c6f6bf-9546-4ea4-a9dd-f79b087e2e1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.274454 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a7c6f6bf-9546-4ea4-a9dd-f79b087e2e1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.274893 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a7c6f6bf-9546-4ea4-a9dd-f79b087e2e1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.541729 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a7c6f6bf-9546-4ea4-a9dd-f79b087e2e1d tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280264 Jun 15 10:23:32.542609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 607/1199] 10.222.0.57 () {62 vars in 1363 bytes} [Wed Jun 15 10:23:32 2022] POST /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:23:32.657577 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8dd13386-2410-4c53-812f-974090121032 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:32.658068 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8dd13386-2410-4c53-812f-974090121032 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:32.663991 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8dd13386-2410-4c53-812f-974090121032 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.664431 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8dd13386-2410-4c53-812f-974090121032 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.665210 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8dd13386-2410-4c53-812f-974090121032 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.665639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8dd13386-2410-4c53-812f-974090121032 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.914634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8dd13386-2410-4c53-812f-974090121032 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/os-volume_attachments/72dcfe4a-c805-4923-b34c-19779358af7c" status: 202 len: 0 microversion: 2.20 time: 0.261127 Jun 15 10:23:32.915420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 593/1200] 10.222.0.57 () {60 vars in 1456 bytes} [Wed Jun 15 10:23:32 2022] DELETE /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/os-volume_attachments/72dcfe4a-c805-4923-b34c-19779358af7c => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:23:32.975091 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cb431ace-fb1f-451f-a263-c7dcd707ac92 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:32.975658 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cb431ace-fb1f-451f-a263-c7dcd707ac92 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:32.983017 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb431ace-fb1f-451f-a263-c7dcd707ac92 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.984314 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb431ace-fb1f-451f-a263-c7dcd707ac92 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.985740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb431ace-fb1f-451f-a263-c7dcd707ac92 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.986318 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb431ace-fb1f-451f-a263-c7dcd707ac92 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:33.066028 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cb431ace-fb1f-451f-a263-c7dcd707ac92 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "POST /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/action" status: 202 len: 0 microversion: 2.20 time: 0.095045 Jun 15 10:23:33.066672 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 608/1201] 10.222.0.57 () {62 vars in 1318 bytes} [Wed Jun 15 10:23:32 2022] POST /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:23:33.074983 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:33.075596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:33.082211 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:33.082686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:33.083450 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:33.083887 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:33.223845 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:33.231869 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:33.233945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:33.235174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-83150e1c-778d-42c2-982c-f1d285a6cce0 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1672 microversion: 2.20 time: 0.164159 Jun 15 10:23:33.236086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 594/1202] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:33 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:34.254718 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:34.255329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:34.262226 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.262733 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.263564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.263944 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.498454 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:34.504343 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f1b04bb1-2845-477b-b454-75e3090515bd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:34.505115 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f1b04bb1-2845-477b-b454-75e3090515bd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:34.519581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b04bb1-2845-477b-b454-75e3090515bd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.522851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:34.524415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:34.525579 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-15b3c498-9350-4069-ac55-fcc76629d0e8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.276346 Jun 15 10:23:34.526146 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 609/1203] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:34 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:34.527346 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b04bb1-2845-477b-b454-75e3090515bd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.528528 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b04bb1-2845-477b-b454-75e3090515bd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.529133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1b04bb1-2845-477b-b454-75e3090515bd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.537037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-3197702c-0e85-457e-950c-a918efe114b2 req-04cca6e4-47e1-4e51-9432-2683fd526fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017fbaea-de4e-4981-b1a7-f85fc6d5fc74", "tag": "a0d42ef5-c08b-4c5d-807e-fde0e4998fd2"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:34.555877 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3197702c-0e85-457e-950c-a918efe114b2 req-04cca6e4-47e1-4e51-9432-2683fd526fd7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.556328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3197702c-0e85-457e-950c-a918efe114b2 req-04cca6e4-47e1-4e51-9432-2683fd526fd7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.568411 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-3197702c-0e85-457e-950c-a918efe114b2 req-04cca6e4-47e1-4e51-9432-2683fd526fd7 service nova] Creating event network-changed:a0d42ef5-c08b-4c5d-807e-fde0e4998fd2 for instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 on hv-cinder-83028 Jun 15 10:23:34.570672 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f1b04bb1-2845-477b-b454-75e3090515bd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:23:34.573653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-3197702c-0e85-457e-950c-a918efe114b2 req-04cca6e4-47e1-4e51-9432-2683fd526fd7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046223 Jun 15 10:23:34.577445 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 610/1204] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:34.665492 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f1b04bb1-2845-477b-b454-75e3090515bd tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "DELETE /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 204 len: 0 microversion: 2.1 time: 0.164770 Jun 15 10:23:34.666513 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 595/1205] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:23:34 2022] DELETE /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:23:34.678393 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a0a9d175-6a5a-49f2-9202-f5e96cfa9067 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:34.679267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a0a9d175-6a5a-49f2-9202-f5e96cfa9067 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:34.685987 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0a9d175-6a5a-49f2-9202-f5e96cfa9067 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.687238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0a9d175-6a5a-49f2-9202-f5e96cfa9067 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.688300 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0a9d175-6a5a-49f2-9202-f5e96cfa9067 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.688840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a0a9d175-6a5a-49f2-9202-f5e96cfa9067 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.830149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a0a9d175-6a5a-49f2-9202-f5e96cfa9067 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:34.838534 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a0a9d175-6a5a-49f2-9202-f5e96cfa9067 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.165152 Jun 15 10:23:34.839111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 611/1206] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:34 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:35.544789 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:35.545427 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:35.552460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.552909 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.553668 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.554105 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.569633 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:35.695342 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:35.703867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:35.705377 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:35.706560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c0594e9f-64a3-43e7-9e33-24297348f447 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.166136 Jun 15 10:23:35.707118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 596/1207] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:35 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:35.857011 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-854b8b87-24ed-467c-9b93-c3e931f1ef65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:35.857728 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-854b8b87-24ed-467c-9b93-c3e931f1ef65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:35.865310 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-854b8b87-24ed-467c-9b93-c3e931f1ef65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.866674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-854b8b87-24ed-467c-9b93-c3e931f1ef65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.866674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-854b8b87-24ed-467c-9b93-c3e931f1ef65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.867001 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-854b8b87-24ed-467c-9b93-c3e931f1ef65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:36.035647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-854b8b87-24ed-467c-9b93-c3e931f1ef65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:36.043237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-854b8b87-24ed-467c-9b93-c3e931f1ef65 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.190198 Jun 15 10:23:36.044134 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 612/1208] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:35 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:36.725168 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:36.725774 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:36.732216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:36.732664 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:36.733635 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:36.734073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:36.892808 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:36.900646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:36.902199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:36.903384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-726e2204-ca28-4466-a92a-bebbc565b206 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.182085 Jun 15 10:23:36.903946 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 597/1209] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:36 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:37.061315 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2e3d1c71-a029-4bf6-88cc-cf75e3855aeb tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:37.062523 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2e3d1c71-a029-4bf6-88cc-cf75e3855aeb tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:37.069111 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e3d1c71-a029-4bf6-88cc-cf75e3855aeb tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:37.069577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e3d1c71-a029-4bf6-88cc-cf75e3855aeb tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:37.070460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e3d1c71-a029-4bf6-88cc-cf75e3855aeb tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:37.070914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2e3d1c71-a029-4bf6-88cc-cf75e3855aeb tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:37.287143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2e3d1c71-a029-4bf6-88cc-cf75e3855aeb tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:37.294791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2e3d1c71-a029-4bf6-88cc-cf75e3855aeb tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1566 microversion: 2.1 time: 0.237151 Jun 15 10:23:37.295227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 613/1210] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:37 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:37.782844 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3f4eadfe-1b0e-47cf-a7d5-329538b583b3 req-08e97d68-e0b7-420c-8ddf-6739ef8684ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017fbaea-de4e-4981-b1a7-f85fc6d5fc74", "name": "network-vif-deleted", "tag": "a0d42ef5-c08b-4c5d-807e-fde0e4998fd2"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:37.792462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3f4eadfe-1b0e-47cf-a7d5-329538b583b3 req-08e97d68-e0b7-420c-8ddf-6739ef8684ff service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:37.793254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3f4eadfe-1b0e-47cf-a7d5-329538b583b3 req-08e97d68-e0b7-420c-8ddf-6739ef8684ff service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:37.808810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3f4eadfe-1b0e-47cf-a7d5-329538b583b3 req-08e97d68-e0b7-420c-8ddf-6739ef8684ff service nova] Creating event network-vif-deleted:a0d42ef5-c08b-4c5d-807e-fde0e4998fd2 for instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 on hv-cinder-83028 Jun 15 10:23:37.816330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3f4eadfe-1b0e-47cf-a7d5-329538b583b3 req-08e97d68-e0b7-420c-8ddf-6739ef8684ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040110 Jun 15 10:23:37.818574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 598/1211] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:37.925027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:37.926137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:37.932614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:37.933143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:37.934000 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:37.934532 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:38.096920 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:38.111044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:38.112842 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:38.114229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-59758282-8025-4099-b90d-5a3700576a89 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.193920 Jun 15 10:23:38.128860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 614/1212] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:37 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:38.314008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0164024b-7930-4599-afd4-d3ce0202968c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:38.315198 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0164024b-7930-4599-afd4-d3ce0202968c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:38.322782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0164024b-7930-4599-afd4-d3ce0202968c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:38.323548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0164024b-7930-4599-afd4-d3ce0202968c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:38.324404 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0164024b-7930-4599-afd4-d3ce0202968c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:38.324916 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0164024b-7930-4599-afd4-d3ce0202968c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:38.391278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0164024b-7930-4599-afd4-d3ce0202968c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:38.400214 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0164024b-7930-4599-afd4-d3ce0202968c tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.092251 Jun 15 10:23:38.411240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 599/1213] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:38 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:39.137385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:39.138799 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:39.148193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:39.149020 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:39.150155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:39.150635 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:39.282802 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:39.290605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:39.292096 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:39.293277 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d5e64c14-b964-479f-981f-ceeff625ce9c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.161360 Jun 15 10:23:39.293827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 615/1214] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:39 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:39.417265 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1c4a31f8-4d70-4834-925a-66303c7a749b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:39.417880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1c4a31f8-4d70-4834-925a-66303c7a749b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:39.424765 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c4a31f8-4d70-4834-925a-66303c7a749b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:39.425220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c4a31f8-4d70-4834-925a-66303c7a749b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:39.425993 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c4a31f8-4d70-4834-925a-66303c7a749b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:39.426587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1c4a31f8-4d70-4834-925a-66303c7a749b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:39.491712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1c4a31f8-4d70-4834-925a-66303c7a749b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:39.499699 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1c4a31f8-4d70-4834-925a-66303c7a749b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.085778 Jun 15 10:23:39.500264 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 600/1215] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:39 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:40.312444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:40.313060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:40.319827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:40.320225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:40.321009 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:40.321451 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:40.460667 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:40.464118 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:40.470880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:40.472373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:40.473530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8c479efd-1ff8-412f-a755-66e2c8a7761b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.165605 Jun 15 10:23:40.474085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 616/1216] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:40 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:40.517157 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7cd65ccd-c8b2-4037-898e-deb4aaf4dad0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:40.517801 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7cd65ccd-c8b2-4037-898e-deb4aaf4dad0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:40.524306 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7cd65ccd-c8b2-4037-898e-deb4aaf4dad0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:40.524764 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7cd65ccd-c8b2-4037-898e-deb4aaf4dad0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:40.525531 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7cd65ccd-c8b2-4037-898e-deb4aaf4dad0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:40.525970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7cd65ccd-c8b2-4037-898e-deb4aaf4dad0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:40.588646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-7cd65ccd-c8b2-4037-898e-deb4aaf4dad0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:40.597158 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7cd65ccd-c8b2-4037-898e-deb4aaf4dad0 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.084630 Jun 15 10:23:40.597728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 601/1217] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:40 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:41.615074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-72fa173b-4768-47dd-8245-620e65dc3663 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:41.615688 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-72fa173b-4768-47dd-8245-620e65dc3663 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:41.622288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72fa173b-4768-47dd-8245-620e65dc3663 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:41.622742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72fa173b-4768-47dd-8245-620e65dc3663 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:41.623506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72fa173b-4768-47dd-8245-620e65dc3663 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:41.623941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-72fa173b-4768-47dd-8245-620e65dc3663 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:41.637235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:41.637845 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:41.643878 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:41.644330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:41.645075 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:41.645509 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:41.688040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-72fa173b-4768-47dd-8245-620e65dc3663 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:41.695695 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-72fa173b-4768-47dd-8245-620e65dc3663 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.084543 Jun 15 10:23:41.696269 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 602/1218] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:41 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:41.782554 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:41.790399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:41.791884 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:41.793024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b9f02a9d-1766-47fb-b150-430d0ea96f63 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.305174 Jun 15 10:23:41.793581 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 617/1219] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:41 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:42.714082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a9636800-eb75-4715-9e99-c7cf8a0a787b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:42.714784 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a9636800-eb75-4715-9e99-c7cf8a0a787b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:42.722185 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a9636800-eb75-4715-9e99-c7cf8a0a787b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:42.722665 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a9636800-eb75-4715-9e99-c7cf8a0a787b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:42.723466 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a9636800-eb75-4715-9e99-c7cf8a0a787b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:42.723904 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a9636800-eb75-4715-9e99-c7cf8a0a787b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:42.807651 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a9636800-eb75-4715-9e99-c7cf8a0a787b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:42.814261 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:42.815595 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:42.819842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a9636800-eb75-4715-9e99-c7cf8a0a787b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.109475 Jun 15 10:23:42.820832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 603/1220] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:42 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:42.825423 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:42.825910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:42.827002 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:42.827959 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:42.993025 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:43.002632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:43.004760 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:43.006427 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8baa2cad-303e-4e9a-955a-772d5b90e487 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.198815 Jun 15 10:23:43.007405 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 618/1221] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:42 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:23:43.837556 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-59c105a2-00dd-4aba-b27a-efdd947f6f95 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:43.838232 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-59c105a2-00dd-4aba-b27a-efdd947f6f95 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:43.845271 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-59c105a2-00dd-4aba-b27a-efdd947f6f95 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:43.845726 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-59c105a2-00dd-4aba-b27a-efdd947f6f95 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:43.846524 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-59c105a2-00dd-4aba-b27a-efdd947f6f95 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:43.846963 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-59c105a2-00dd-4aba-b27a-efdd947f6f95 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:43.908963 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-59c105a2-00dd-4aba-b27a-efdd947f6f95 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:43.917253 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-59c105a2-00dd-4aba-b27a-efdd947f6f95 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.083622 Jun 15 10:23:43.917835 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 604/1222] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:43 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:44.032973 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:44.033526 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:44.040378 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:44.040834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:44.041604 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:44.042044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:44.172494 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:44.180495 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:44.181986 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:44.183169 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c1ac6aa6-044f-4cb3-8679-1f3bcf9ae377 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.155078 Jun 15 10:23:44.183724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 619/1223] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:44 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:44.934027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ea55897b-aae4-41d8-8b34-b471b4ac75d7 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:44.934611 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ea55897b-aae4-41d8-8b34-b471b4ac75d7 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:44.941833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea55897b-aae4-41d8-8b34-b471b4ac75d7 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:44.942288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea55897b-aae4-41d8-8b34-b471b4ac75d7 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:44.943062 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea55897b-aae4-41d8-8b34-b471b4ac75d7 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:44.943490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ea55897b-aae4-41d8-8b34-b471b4ac75d7 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:45.005129 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ea55897b-aae4-41d8-8b34-b471b4ac75d7 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:45.012607 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ea55897b-aae4-41d8-8b34-b471b4ac75d7 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.082502 Jun 15 10:23:45.013169 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 605/1224] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:44 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:45.204870 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:45.205585 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:45.207971 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:45.213891 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:45.214374 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:45.215152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:45.215601 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:45.377192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:45.385484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:45.387050 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:45.388227 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c90f1a08-9ddd-42d6-a028-3bffaee1be14 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.187936 Jun 15 10:23:45.388935 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 620/1225] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:45 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:46.029908 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c1fbdb5d-240d-4874-b81a-1614d9ccb8b4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:46.030541 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c1fbdb5d-240d-4874-b81a-1614d9ccb8b4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:46.037802 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1fbdb5d-240d-4874-b81a-1614d9ccb8b4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.038250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1fbdb5d-240d-4874-b81a-1614d9ccb8b4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.039097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1fbdb5d-240d-4874-b81a-1614d9ccb8b4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.039543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c1fbdb5d-240d-4874-b81a-1614d9ccb8b4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.114215 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c1fbdb5d-240d-4874-b81a-1614d9ccb8b4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:46.122134 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c1fbdb5d-240d-4874-b81a-1614d9ccb8b4 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.096096 Jun 15 10:23:46.123087 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 606/1226] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:46 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:46.409480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:46.410238 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:46.419764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.420319 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.421437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.421874 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.560715 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:46.568638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:46.570154 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:46.571349 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9d8b9ec6-7122-4613-8d67-40785d8d118b tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.167630 Jun 15 10:23:46.571910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 621/1227] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:46 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:47.140047 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-142b66ff-2671-4aa0-9bc0-9c7b17519704 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:47.140669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-142b66ff-2671-4aa0-9bc0-9c7b17519704 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:47.148147 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-142b66ff-2671-4aa0-9bc0-9c7b17519704 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.148603 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-142b66ff-2671-4aa0-9bc0-9c7b17519704 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.149588 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-142b66ff-2671-4aa0-9bc0-9c7b17519704 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.150207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-142b66ff-2671-4aa0-9bc0-9c7b17519704 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.214037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-142b66ff-2671-4aa0-9bc0-9c7b17519704 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:47.222577 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-142b66ff-2671-4aa0-9bc0-9c7b17519704 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.086339 Jun 15 10:23:47.223144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 607/1228] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:47 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:47.588954 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:47.589567 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:47.596946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.597445 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.598358 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.598806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.744759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:47.758170 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:47.759895 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:47.761198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dbfc60e6-ddaf-4f38-95da-d958e527dbf3 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.176218 Jun 15 10:23:47.761788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 622/1229] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:47 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:48.239655 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4459f668-9ebb-487e-8a2a-43a928d53f5b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:48.240262 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4459f668-9ebb-487e-8a2a-43a928d53f5b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:48.242707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:48.247755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4459f668-9ebb-487e-8a2a-43a928d53f5b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:48.248195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4459f668-9ebb-487e-8a2a-43a928d53f5b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:48.248941 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4459f668-9ebb-487e-8a2a-43a928d53f5b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:48.249376 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4459f668-9ebb-487e-8a2a-43a928d53f5b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:48.314114 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4459f668-9ebb-487e-8a2a-43a928d53f5b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:48.321818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4459f668-9ebb-487e-8a2a-43a928d53f5b tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.086651 Jun 15 10:23:48.322405 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 608/1230] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:48 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:48.787922 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:48.788535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:48.794946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:48.795394 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:48.796146 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:48.796580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:48.945568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:48.954898 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:48.956413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:48.957636 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-83763c0a-64b7-4924-8e5e-ab87a2932d90 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.173674 Jun 15 10:23:48.958422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 623/1231] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:48 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:49.339214 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5e24c269-8a59-4033-a92e-3e60fae146a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:49.339831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5e24c269-8a59-4033-a92e-3e60fae146a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:49.346988 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e24c269-8a59-4033-a92e-3e60fae146a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:49.347441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e24c269-8a59-4033-a92e-3e60fae146a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:49.348203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e24c269-8a59-4033-a92e-3e60fae146a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:49.348640 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e24c269-8a59-4033-a92e-3e60fae146a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:49.413340 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5e24c269-8a59-4033-a92e-3e60fae146a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:49.420893 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5e24c269-8a59-4033-a92e-3e60fae146a8 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.085560 Jun 15 10:23:49.421465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 609/1232] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:49 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:49.976229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:49.976847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:49.983365 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:49.983827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:49.984594 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:49.985038 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:50.123004 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:50.131653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:50.133138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:50.134294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bd496ecf-8cb8-4299-813d-d70e7af20353 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.161951 Jun 15 10:23:50.134866 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 624/1233] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:49 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:50.438543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0bbf94a5-675b-4138-b66b-07b1ac4b2352 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:50.439801 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0bbf94a5-675b-4138-b66b-07b1ac4b2352 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:50.446366 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0bbf94a5-675b-4138-b66b-07b1ac4b2352 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:50.446818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0bbf94a5-675b-4138-b66b-07b1ac4b2352 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:50.447574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0bbf94a5-675b-4138-b66b-07b1ac4b2352 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:50.448006 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0bbf94a5-675b-4138-b66b-07b1ac4b2352 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:50.509593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0bbf94a5-675b-4138-b66b-07b1ac4b2352 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:50.518117 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0bbf94a5-675b-4138-b66b-07b1ac4b2352 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.082499 Jun 15 10:23:50.518723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 610/1234] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:50 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:51.152769 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:51.153382 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:51.160463 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:51.160913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:51.161667 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:51.162100 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:51.291399 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:51.299330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:51.300846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:51.301992 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6aa76bf8-8da0-4774-8630-dd936f38e605 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.153127 Jun 15 10:23:51.302577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 625/1235] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:51 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:51.535551 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d17c8445-63d4-4dba-ae3f-4b0cd8ed4559 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:51.536079 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d17c8445-63d4-4dba-ae3f-4b0cd8ed4559 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:51.542535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d17c8445-63d4-4dba-ae3f-4b0cd8ed4559 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:51.542974 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d17c8445-63d4-4dba-ae3f-4b0cd8ed4559 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:51.543725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d17c8445-63d4-4dba-ae3f-4b0cd8ed4559 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:51.544154 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d17c8445-63d4-4dba-ae3f-4b0cd8ed4559 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:51.606144 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d17c8445-63d4-4dba-ae3f-4b0cd8ed4559 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:51.614237 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d17c8445-63d4-4dba-ae3f-4b0cd8ed4559 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.083104 Jun 15 10:23:51.614818 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 611/1236] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:51 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:52.259011 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-344daa26-d719-4edf-9f08-36e10fe065f8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:52.259549 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-344daa26-d719-4edf-9f08-36e10fe065f8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:52.265852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-344daa26-d719-4edf-9f08-36e10fe065f8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:52.266325 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-344daa26-d719-4edf-9f08-36e10fe065f8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:52.267815 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-344daa26-d719-4edf-9f08-36e10fe065f8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:52.268251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-344daa26-d719-4edf-9f08-36e10fe065f8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:52.289869 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-344daa26-d719-4edf-9f08-36e10fe065f8 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/ips" status: 200 len: 151 microversion: 2.1 time: 0.034703 Jun 15 10:23:52.290444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 626/1237] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:23:52 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:52.320061 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:52.320663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:52.326552 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:52.326995 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:52.327745 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:52.328174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:52.470089 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:52.478194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:52.479694 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:52.480865 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5d27c5b1-57c5-49b8-be97-04039fe16d3e tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.164619 Jun 15 10:23:52.481432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 612/1238] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:52 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:52.633638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e37450ca-4668-4d87-92ef-f72ec8605425 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:52.634478 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e37450ca-4668-4d87-92ef-f72ec8605425 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:52.640662 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e37450ca-4668-4d87-92ef-f72ec8605425 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:52.641192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e37450ca-4668-4d87-92ef-f72ec8605425 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:52.642224 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e37450ca-4668-4d87-92ef-f72ec8605425 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:52.642951 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e37450ca-4668-4d87-92ef-f72ec8605425 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:52.704108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e37450ca-4668-4d87-92ef-f72ec8605425 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:52.712572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e37450ca-4668-4d87-92ef-f72ec8605425 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1381 microversion: 2.1 time: 0.084374 Jun 15 10:23:52.713142 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 627/1239] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:52 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1381 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:53.499278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:53.499885 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:53.506358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:53.506829 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:53.507580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:53.508039 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:53.640919 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f37ce7bc-d055-45f3-9aa8-e7c2264bbac1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f835de01-aa74-4e80-a0a2-4f022b20354f"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:53.642691 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f37ce7bc-d055-45f3-9aa8-e7c2264bbac1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:53.646015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:53.648451 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:53.649311 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f37ce7bc-d055-45f3-9aa8-e7c2264bbac1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:53.649815 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f37ce7bc-d055-45f3-9aa8-e7c2264bbac1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:53.650712 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f37ce7bc-d055-45f3-9aa8-e7c2264bbac1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:53.651194 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f37ce7bc-d055-45f3-9aa8-e7c2264bbac1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:53.655780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:53.657272 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:53.658462 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-328851bd-0961-44a4-a5c5-eecf3fec13f9 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.163014 Jun 15 10:23:53.659027 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 613/1240] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:53 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:53.732356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-77511359-b09b-4683-a387-708e8319e741 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:53.732970 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-77511359-b09b-4683-a387-708e8319e741 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:53.739084 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-77511359-b09b-4683-a387-708e8319e741 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:53.739521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-77511359-b09b-4683-a387-708e8319e741 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:53.740292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-77511359-b09b-4683-a387-708e8319e741 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:53.740722 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-77511359-b09b-4683-a387-708e8319e741 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:53.804710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-77511359-b09b-4683-a387-708e8319e741 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:53.812175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-77511359-b09b-4683-a387-708e8319e741 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1219 microversion: 2.1 time: 0.084400 Jun 15 10:23:53.812735 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 614/1241] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:53 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:54.676465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:54.677134 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:54.683550 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:54.684007 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:54.684764 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:54.685203 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:54.815873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:54.823896 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:54.825420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:54.826883 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a35cc560-e725-4166-b2c9-7e580b3dd047 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.154864 Jun 15 10:23:54.827441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 615/1242] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:54 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:23:54.832205 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9da55e00-7bfe-4716-9398-94bdf620f931 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:54.832814 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9da55e00-7bfe-4716-9398-94bdf620f931 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:54.838476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9da55e00-7bfe-4716-9398-94bdf620f931 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:54.838933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9da55e00-7bfe-4716-9398-94bdf620f931 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:54.839689 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9da55e00-7bfe-4716-9398-94bdf620f931 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:54.840127 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9da55e00-7bfe-4716-9398-94bdf620f931 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:54.900854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9da55e00-7bfe-4716-9398-94bdf620f931 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:54.908475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9da55e00-7bfe-4716-9398-94bdf620f931 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1219 microversion: 2.1 time: 0.080015 Jun 15 10:23:54.909050 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 616/1243] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:54 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:55.846307 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:55.847015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:55.853435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:55.853874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:55.854661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:55.855100 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:56.016485 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:56.024675 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:56.026208 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:56.027521 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cfc004d0-de9e-425f-bc8f-ee9206cb70d6 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.185953 Jun 15 10:23:56.028334 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 617/1244] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:55 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:23:56.033663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:56.034411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:56.042296 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:56.042788 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:56.043573 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:56.044013 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:56.078679 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:56.079181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:56.079727 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lazy-loading 'fault' on Instance uuid 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:23:56.106219 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f37ce7bc-d055-45f3-9aa8-e7c2264bbac1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.468959 Jun 15 10:23:56.106832 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 628/1245] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:23:53 2022] POST /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments => generated 194 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:23:56.129588 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211501490d314544b1d60a8b42cd0cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a712f2d9e44cc6825ee925f3f068fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:56.137571 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-279768b2-ef11-422f-a02f-a39cab92d45e tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 200 len: 1224 microversion: 2.1 time: 0.107896 Jun 15 10:23:56.138331 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 618/1246] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:56 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:57.049989 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:57.050727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:57.056937 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:57.057392 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:57.058155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:57.058617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:57.156597 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:57.158673 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] [instance: 017fbaea-de4e-4981-b1a7-f85fc6d5fc74] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:57.165038 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:57.165488 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:57.166249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:57.166876 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:57.181566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] HTTP exception thrown: Instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 could not be found. Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Request method failure captured: Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 HTTP/1.1 Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbF0iFzZ4YSfv3r9JAm2luVn3Zqz_IOhD2okbg9G9-zcrD3CiJjY54GqOqCIPOUFz9-bZ_MAY8lfe9fJgWfcN8Nzeca2pN92DlMqBl8QDLSZ3PaoyucksRoZWERN6cAkOHNsnp2O8y7HJ4lPE7gJPGAXumeZusUerf1iDuwhdNryL-4 Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: d6a712f2d9e44cc6825ee925f3f068fd Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestShelveInstance-107337229 Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:23:57.183175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d6a712f2d9e44cc6825ee925f3f068fd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6a712f2d9e44cc6825ee925f3f068fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d6a712f2d9e44cc6825ee925f3f068fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d6a712f2d9e44cc6825ee925f3f068fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestShelveInstance-107337229 Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: d6a712f2d9e44cc6825ee925f3f068fd Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestShelveInstance-107337229 Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-TestShelveInstance-107337229-project Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 211501490d314544b1d60a8b42cd0cb1 Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestShelveInstance-107337229-project Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 could not be found. Jun 15 10:23:57.184961 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '017fbaea-de4e-4981-b1a7-f85fc6d5fc74'} Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 could not be found. Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:57.186018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 could not be found. Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 could not be found. Jun 15 10:23:57.187644 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:23:57.189212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Returning 404 to user: Instance 017fbaea-de4e-4981-b1a7-f85fc6d5fc74 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:57.189212 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-def9c6aa-6ddb-4264-9dfc-0eee8b1da8c5 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74" status: 404 len: 111 microversion: 2.1 time: 0.032058 Jun 15 10:23:57.197417 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 619/1247] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:57 2022] GET /compute/v2.1/servers/017fbaea-de4e-4981-b1a7-f85fc6d5fc74 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:23:57.202066 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:57.210964 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:57.212730 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:57.213895 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1ee29ed8-0d44-46c9-87c6-95f960cd1b6f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.168838 Jun 15 10:23:57.214478 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 629/1248] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:57 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:57.358570 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f59bb822-8280-4918-8529-cc42446517f9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] Calling method '.version_select at 0x7fe256174280>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:57.377526 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f59bb822-8280-4918-8529-cc42446517f9 tempest-TestShelveInstance-107337229 tempest-TestShelveInstance-107337229-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1172135021" status: 202 len: 0 microversion: 2.1 time: 0.022670 Jun 15 10:23:57.378475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 620/1249] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Jun 15 10:23:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1172135021 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:23:58.233563 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:58.234570 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:58.242428 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:58.242883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:58.243732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:58.244179 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:58.473317 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:58.481556 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:58.483230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:58.484487 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8a331656-93a2-48c6-9040-41f3ff518e1c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.255399 Jun 15 10:23:58.485128 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 630/1250] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:58 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:23:59.504285 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:59.505731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:59.513223 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:59.513683 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:59.515021 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:59.515751 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:59.742280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:59.750350 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:59.752602 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:59.753874 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3617b687-9afb-452a-9c92-d7c07e4c4921 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.254387 Jun 15 10:23:59.754565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 621/1251] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:23:59 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:24:00.512647 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-6fc97182-4550-4ae8-8647-e876cbfd7393 req-5c581e0f-115f-49be-a5bc-000fc9f8c2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3", "name": "network-vif-plugged", "status": "completed", "tag": "132b131d-7c10-4f96-96c1-cc640e8d71a7"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:00.522215 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-6fc97182-4550-4ae8-8647-e876cbfd7393 req-5c581e0f-115f-49be-a5bc-000fc9f8c2a8 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:00.522880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-6fc97182-4550-4ae8-8647-e876cbfd7393 req-5c581e0f-115f-49be-a5bc-000fc9f8c2a8 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:00.538363 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-6fc97182-4550-4ae8-8647-e876cbfd7393 req-5c581e0f-115f-49be-a5bc-000fc9f8c2a8 service nova] Creating event network-vif-plugged:132b131d-7c10-4f96-96c1-cc640e8d71a7 for instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 on hv-cinder-83028 Jun 15 10:24:00.544934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-6fc97182-4550-4ae8-8647-e876cbfd7393 req-5c581e0f-115f-49be-a5bc-000fc9f8c2a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035980 Jun 15 10:24:00.545549 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 631/1252] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:00.776888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:00.778907 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:00.802720 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:00.803188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:00.805136 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:00.805579 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:01.072047 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:01.080919 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:01.082725 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:01.084083 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5b602f62-7bf3-4b54-a5ef-bd15ac700cfd tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.316094 Jun 15 10:24:01.085582 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 622/1253] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:24:00 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:24:02.103434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:02.104152 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:02.114727 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:02.115429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:02.116548 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:02.117155 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:02.385907 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:02.400276 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:02.401835 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:02.403090 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-093b9fc9-3340-4f79-8147-3c113d9fc043 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.304521 Jun 15 10:24:02.403906 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 632/1254] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:24:02 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:24:03.422288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:03.422958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:03.429604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:03.430063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:03.430958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:03.431402 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:03.589831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:03.598717 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:03.600239 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:03.601433 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-86c4ed9b-614a-47bc-ae5f-ee1ffdabbc1a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.183449 Jun 15 10:24:03.602003 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 623/1255] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:24:03 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:24:04.619818 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:04.620955 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:04.628718 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:04.629375 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:04.630160 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:04.630637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:04.634958 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:04.770475 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:04.778530 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:04.780253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:04.781339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e0bd148f-2c42-489f-a231-126149e9a1bf tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.165565 Jun 15 10:24:04.782149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 633/1256] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:24:04 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:24:05.799834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:05.800554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:05.807456 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:05.807912 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:05.808698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:05.809138 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:05.949996 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:05.957958 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:05.959491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:05.960653 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-1485026c-4d0d-458f-be2f-142c55b320c8 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1730 microversion: 2.20 time: 0.165002 Jun 15 10:24:05.961221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 624/1257] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:24:05 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:24:06.979084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:06.979702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:06.986511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:06.986978 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:06.987770 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:06.988216 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:07.123720 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:07.133414 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:07.135695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:07.137321 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bd63b5f6-a066-425c-a03b-6734bbd17e57 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1717 microversion: 2.20 time: 0.162416 Jun 15 10:24:07.137902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 634/1258] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:24:06 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:24:07.874255 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-544813ab-68c7-49f3-b2ed-1547d5671cec tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: .version_select at 0x7fe25a826790>, body: {"keypair": {"name": "tempest-keypair-1933403644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRvRcE0x1xr3Dxm9mPJ2LCHjL+JlxXbzKF/rfEuU4hXQoohPlGjupHbVSLALJESZ0BpoUO9+aHntkEyCXs8FwS72EAzjO6x45UKCyeX9Vzuup0uUsqCh5TH1CDfTiIrww=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:07.891530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-544813ab-68c7-49f3-b2ed-1547d5671cec tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for project 64d59f3545044033ab48f6253122fe64. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:24:07.895616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-544813ab-68c7-49f3-b2ed-1547d5671cec tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for user 016f3ad72de247f991f1939a987a4ffb and project 64d59f3545044033ab48f6253122fe64. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:24:07.924134 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-544813ab-68c7-49f3-b2ed-1547d5671cec tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053205 Jun 15 10:24:07.925236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 625/1259] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:24:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:09.194653 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-19168538", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a0c7486-be27-43d5-98e8-c4309dfe22aa"}], "security_groups": [{"name": "tempest-securitygroup--1770693535"}], "key_name": "tempest-keypair-1933403644", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:09.300413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] validate_networks() for [('4a0c7486-be27-43d5-98e8-c4309dfe22aa', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:24:09.779471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:24:09.779904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:24:09.780522 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:24:09.780941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:24:09.781360 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:24:09.792618 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:09.793072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:09.793868 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:09.794377 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:09.811600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for project 64d59f3545044033ab48f6253122fe64. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:24:09.816617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for user 016f3ad72de247f991f1939a987a4ffb and project 64d59f3545044033ab48f6253122fe64. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:24:09.827505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:24:09.830250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:24:09.875263 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-10d6d547-aef4-4d63-b251-20d07e8f2df0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684853 Jun 15 10:24:09.875907 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 635/1260] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:24:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:24:09.886914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-55dc431c-c7b4-4417-a84a-0e6d6434ebfd tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:09.887531 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-55dc431c-c7b4-4417-a84a-0e6d6434ebfd tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:09.947368 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-55dc431c-c7b4-4417-a84a-0e6d6434ebfd tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:09.956202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-55dc431c-c7b4-4417-a84a-0e6d6434ebfd tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1240 microversion: 2.1 time: 0.073725 Jun 15 10:24:09.956771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 626/1261] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:09 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:10.974381 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dad2240e-dd8f-4956-b098-2ac319cad521 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:10.975057 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dad2240e-dd8f-4956-b098-2ac319cad521 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:10.981946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dad2240e-dd8f-4956-b098-2ac319cad521 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:10.982469 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dad2240e-dd8f-4956-b098-2ac319cad521 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:10.983251 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dad2240e-dd8f-4956-b098-2ac319cad521 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:10.983694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dad2240e-dd8f-4956-b098-2ac319cad521 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:11.054348 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dad2240e-dd8f-4956-b098-2ac319cad521 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:11.062946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dad2240e-dd8f-4956-b098-2ac319cad521 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1300 microversion: 2.1 time: 0.093657 Jun 15 10:24:11.073661 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 636/1262] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:10 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:12.080662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d507a83b-b957-4eec-a4ae-69884b6862ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:12.082174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d507a83b-b957-4eec-a4ae-69884b6862ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:12.088630 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d507a83b-b957-4eec-a4ae-69884b6862ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:12.089321 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d507a83b-b957-4eec-a4ae-69884b6862ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:12.089870 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d507a83b-b957-4eec-a4ae-69884b6862ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:12.090344 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d507a83b-b957-4eec-a4ae-69884b6862ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:12.223392 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d507a83b-b957-4eec-a4ae-69884b6862ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:12.230752 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d507a83b-b957-4eec-a4ae-69884b6862ac tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.154788 Jun 15 10:24:12.231326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 627/1263] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:12 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:12.530199 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-d9e85f22-f142-4587-ae42-ea856d8779fd req-b640e129-4a02-4433-bd00-1cd6fa8c5231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa75463-37d9-41ab-a4bc-6e3b07aa318f", "tag": "73c7055c-4454-4744-8a62-7c4ff18bf4f8"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:12.540072 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-d9e85f22-f142-4587-ae42-ea856d8779fd req-b640e129-4a02-4433-bd00-1cd6fa8c5231 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:12.540780 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-d9e85f22-f142-4587-ae42-ea856d8779fd req-b640e129-4a02-4433-bd00-1cd6fa8c5231 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:12.568901 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-d9e85f22-f142-4587-ae42-ea856d8779fd req-b640e129-4a02-4433-bd00-1cd6fa8c5231 service nova] Creating event network-changed:73c7055c-4454-4744-8a62-7c4ff18bf4f8 for instance efa75463-37d9-41ab-a4bc-6e3b07aa318f on hv-cinder-83028 Jun 15 10:24:12.574980 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-d9e85f22-f142-4587-ae42-ea856d8779fd req-b640e129-4a02-4433-bd00-1cd6fa8c5231 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048616 Jun 15 10:24:12.578437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 637/1264] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:13.247830 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3f60b832-b1eb-43bc-94c1-209024a3ddc9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:13.248443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3f60b832-b1eb-43bc-94c1-209024a3ddc9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:13.255253 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f60b832-b1eb-43bc-94c1-209024a3ddc9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:13.255693 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f60b832-b1eb-43bc-94c1-209024a3ddc9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:13.256452 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f60b832-b1eb-43bc-94c1-209024a3ddc9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:13.257219 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3f60b832-b1eb-43bc-94c1-209024a3ddc9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:13.394457 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-3f60b832-b1eb-43bc-94c1-209024a3ddc9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:13.401809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3f60b832-b1eb-43bc-94c1-209024a3ddc9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.157841 Jun 15 10:24:13.402404 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 628/1265] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:13 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:14.373191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1723035380", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-552614952", "security_groups": [{"name": "tempest-secgroup-smoke-132408903"}], "block_device_mapping_v2": [{"uuid": "d6688ec0-d254-4134-9b4d-6d840f42c0bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "82fdb04b-f19e-4e9e-88bc-bf5a50bb7342"}]}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:14.419541 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-d64aa228-1ab9-4a4c-93e8-fe38f9a80c67 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:14.420028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-d64aa228-1ab9-4a4c-93e8-fe38f9a80c67 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:14.426937 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d64aa228-1ab9-4a4c-93e8-fe38f9a80c67 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:14.427422 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d64aa228-1ab9-4a4c-93e8-fe38f9a80c67 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:14.428188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d64aa228-1ab9-4a4c-93e8-fe38f9a80c67 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:14.428633 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-d64aa228-1ab9-4a4c-93e8-fe38f9a80c67 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:14.512016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] validate_networks() for [('82fdb04b-f19e-4e9e-88bc-bf5a50bb7342', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:24:14.649064 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-d64aa228-1ab9-4a4c-93e8-fe38f9a80c67 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:14.656575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-d64aa228-1ab9-4a4c-93e8-fe38f9a80c67 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.241194 Jun 15 10:24:14.657174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 629/1266] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:14 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:14.931639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:24:14.932088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:24:14.932584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:24:14.933029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:24:14.933473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:24:14.943379 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:14.943840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:14.944651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:14.945094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:14.962117 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Getting quotas for project c6cf56db2b454c688b9305ef587f407e. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:24:14.966307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Getting quotas for user 9ee3b5927ffa4ef5b7f617073e083a80 and project c6cf56db2b454c688b9305ef587f407e. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:24:15.024971 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:24:15.027192 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6688ec0-d254-4134-9b4d-6d840f42c0bc',volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:24:15.154802 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0fbca7f8-1b18-4b4b-90ce-a767662e823c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.786342 Jun 15 10:24:15.155460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 638/1267] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:24:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:24:15.166048 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-388b00d4-fa18-4911-8e08-3d1baafd3ea1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:15.166247 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-388b00d4-fa18-4911-8e08-3d1baafd3ea1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:15.218999 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-388b00d4-fa18-4911-8e08-3d1baafd3ea1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:15.226025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-388b00d4-fa18-4911-8e08-3d1baafd3ea1 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1094 microversion: 2.1 time: 0.064175 Jun 15 10:24:15.226585 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 630/1268] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:15 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:15.674772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-518cdf31-1f86-4051-a5fd-9d0d49d7bb75 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:15.675378 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-518cdf31-1f86-4051-a5fd-9d0d49d7bb75 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:15.677394 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:15.683731 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-518cdf31-1f86-4051-a5fd-9d0d49d7bb75 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:15.684177 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-518cdf31-1f86-4051-a5fd-9d0d49d7bb75 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:15.684931 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-518cdf31-1f86-4051-a5fd-9d0d49d7bb75 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:15.685364 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-518cdf31-1f86-4051-a5fd-9d0d49d7bb75 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:15.811866 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-518cdf31-1f86-4051-a5fd-9d0d49d7bb75 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:15.820030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-518cdf31-1f86-4051-a5fd-9d0d49d7bb75 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.150454 Jun 15 10:24:15.820591 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 639/1269] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:15 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:16.243057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-31cdb727-6b5e-4844-8701-bda5fc4dec09 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:16.243669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-31cdb727-6b5e-4844-8701-bda5fc4dec09 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:16.250123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31cdb727-6b5e-4844-8701-bda5fc4dec09 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:16.250601 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31cdb727-6b5e-4844-8701-bda5fc4dec09 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:16.251372 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31cdb727-6b5e-4844-8701-bda5fc4dec09 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:16.252330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-31cdb727-6b5e-4844-8701-bda5fc4dec09 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:16.328183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-31cdb727-6b5e-4844-8701-bda5fc4dec09 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:16.336110 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-31cdb727-6b5e-4844-8701-bda5fc4dec09 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1144 microversion: 2.1 time: 0.096895 Jun 15 10:24:16.337055 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 631/1270] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:16 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:16.837077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dbea4b20-3323-4340-af85-17f1d032bfa5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:16.837678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dbea4b20-3323-4340-af85-17f1d032bfa5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:16.844148 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbea4b20-3323-4340-af85-17f1d032bfa5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:16.844849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbea4b20-3323-4340-af85-17f1d032bfa5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:16.846584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbea4b20-3323-4340-af85-17f1d032bfa5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:16.846720 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbea4b20-3323-4340-af85-17f1d032bfa5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:17.014715 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbea4b20-3323-4340-af85-17f1d032bfa5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:17.027436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dbea4b20-3323-4340-af85-17f1d032bfa5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.194371 Jun 15 10:24:17.028651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 640/1271] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:16 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:17.353605 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f5d3c394-5ccf-4311-a54b-efee9d19d88c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:17.355384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f5d3c394-5ccf-4311-a54b-efee9d19d88c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:17.363199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5d3c394-5ccf-4311-a54b-efee9d19d88c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:17.363912 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5d3c394-5ccf-4311-a54b-efee9d19d88c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:17.364867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5d3c394-5ccf-4311-a54b-efee9d19d88c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:17.365480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f5d3c394-5ccf-4311-a54b-efee9d19d88c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:17.436288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f5d3c394-5ccf-4311-a54b-efee9d19d88c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:17.444866 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f5d3c394-5ccf-4311-a54b-efee9d19d88c tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1210 microversion: 2.1 time: 0.095712 Jun 15 10:24:17.451514 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 632/1272] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:17 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:18.045429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f083ebef-d668-4715-849f-8bc7bc444764 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:18.045972 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f083ebef-d668-4715-849f-8bc7bc444764 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:18.056981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f083ebef-d668-4715-849f-8bc7bc444764 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:18.058574 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f083ebef-d668-4715-849f-8bc7bc444764 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:18.059678 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f083ebef-d668-4715-849f-8bc7bc444764 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:18.060721 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f083ebef-d668-4715-849f-8bc7bc444764 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:18.461563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-263d61d1-ad15-4e9f-adda-8247d3138f2f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:18.462177 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-263d61d1-ad15-4e9f-adda-8247d3138f2f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:18.464529 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:18.470026 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-263d61d1-ad15-4e9f-adda-8247d3138f2f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:18.470578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-263d61d1-ad15-4e9f-adda-8247d3138f2f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:18.471328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-263d61d1-ad15-4e9f-adda-8247d3138f2f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:18.471762 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-263d61d1-ad15-4e9f-adda-8247d3138f2f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:18.533039 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f083ebef-d668-4715-849f-8bc7bc444764 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:18.540377 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f083ebef-d668-4715-849f-8bc7bc444764 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.498868 Jun 15 10:24:18.540951 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 641/1273] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:18 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:18.734851 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-263d61d1-ad15-4e9f-adda-8247d3138f2f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:18.744507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-263d61d1-ad15-4e9f-adda-8247d3138f2f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.286723 Jun 15 10:24:18.745605 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 633/1274] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:18 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:19.046854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-f5f987be-228b-4bb6-9b8e-6351cef698bb req-67eaaeeb-e422-4987-ba78-eda1eff60847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46d3605-3910-41a8-9a91-80edb73244d5", "tag": "05535f67-6da4-45e4-88ef-7dcce81df253"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:19.057311 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f5f987be-228b-4bb6-9b8e-6351cef698bb req-67eaaeeb-e422-4987-ba78-eda1eff60847 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:19.057910 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-f5f987be-228b-4bb6-9b8e-6351cef698bb req-67eaaeeb-e422-4987-ba78-eda1eff60847 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:19.069316 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-f5f987be-228b-4bb6-9b8e-6351cef698bb req-67eaaeeb-e422-4987-ba78-eda1eff60847 service nova] Creating event network-changed:05535f67-6da4-45e4-88ef-7dcce81df253 for instance b46d3605-3910-41a8-9a91-80edb73244d5 on hv-cinder-83028 Jun 15 10:24:19.074194 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-f5f987be-228b-4bb6-9b8e-6351cef698bb req-67eaaeeb-e422-4987-ba78-eda1eff60847 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189945 Jun 15 10:24:19.074851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 642/1275] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:19.351560 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-04d1e6d1-d788-410f-9e99-0c670ca081ef req-07a8ccb6-209c-48ed-9d55-cd846679e8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa75463-37d9-41ab-a4bc-6e3b07aa318f", "name": "network-vif-plugged", "status": "completed", "tag": "73c7055c-4454-4744-8a62-7c4ff18bf4f8"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:19.365324 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-04d1e6d1-d788-410f-9e99-0c670ca081ef req-07a8ccb6-209c-48ed-9d55-cd846679e8b7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:19.367441 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-04d1e6d1-d788-410f-9e99-0c670ca081ef req-07a8ccb6-209c-48ed-9d55-cd846679e8b7 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:19.382885 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-04d1e6d1-d788-410f-9e99-0c670ca081ef req-07a8ccb6-209c-48ed-9d55-cd846679e8b7 service nova] Creating event network-vif-plugged:73c7055c-4454-4744-8a62-7c4ff18bf4f8 for instance efa75463-37d9-41ab-a4bc-6e3b07aa318f on hv-cinder-83028 Jun 15 10:24:19.388195 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-04d1e6d1-d788-410f-9e99-0c670ca081ef req-07a8ccb6-209c-48ed-9d55-cd846679e8b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040906 Jun 15 10:24:19.388802 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 634/1276] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:19.557484 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8407ca3a-1be0-49a8-8933-d2d8b29e043b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:19.558194 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8407ca3a-1be0-49a8-8933-d2d8b29e043b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:19.565048 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8407ca3a-1be0-49a8-8933-d2d8b29e043b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:19.565505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8407ca3a-1be0-49a8-8933-d2d8b29e043b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:19.566310 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8407ca3a-1be0-49a8-8933-d2d8b29e043b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:19.566748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8407ca3a-1be0-49a8-8933-d2d8b29e043b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:19.703630 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8407ca3a-1be0-49a8-8933-d2d8b29e043b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:19.711642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8407ca3a-1be0-49a8-8933-d2d8b29e043b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.158468 Jun 15 10:24:19.712207 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 643/1277] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:19 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:19.763130 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-65323d52-864e-42fe-abbf-827d9ff9a575 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:19.763824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-65323d52-864e-42fe-abbf-827d9ff9a575 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:19.770141 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-65323d52-864e-42fe-abbf-827d9ff9a575 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:19.770631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-65323d52-864e-42fe-abbf-827d9ff9a575 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:19.771382 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-65323d52-864e-42fe-abbf-827d9ff9a575 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:19.771816 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-65323d52-864e-42fe-abbf-827d9ff9a575 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:19.786622 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=100 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:19.902554 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-65323d52-864e-42fe-abbf-827d9ff9a575 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:19.910614 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-65323d52-864e-42fe-abbf-827d9ff9a575 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.151569 Jun 15 10:24:19.911184 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 635/1278] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:19 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:20.729115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-44e0b3f3-7f4c-41cf-bee5-d30e967c3202 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:20.729732 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-44e0b3f3-7f4c-41cf-bee5-d30e967c3202 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:20.737157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44e0b3f3-7f4c-41cf-bee5-d30e967c3202 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.737609 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44e0b3f3-7f4c-41cf-bee5-d30e967c3202 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.738705 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44e0b3f3-7f4c-41cf-bee5-d30e967c3202 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.739145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-44e0b3f3-7f4c-41cf-bee5-d30e967c3202 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.929588 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-954f4935-aeab-45cd-95cc-17630f7a6491 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:20.931059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-954f4935-aeab-45cd-95cc-17630f7a6491 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:20.937696 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-954f4935-aeab-45cd-95cc-17630f7a6491 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.938151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-954f4935-aeab-45cd-95cc-17630f7a6491 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.939548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-954f4935-aeab-45cd-95cc-17630f7a6491 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.939983 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-954f4935-aeab-45cd-95cc-17630f7a6491 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.956015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-44e0b3f3-7f4c-41cf-bee5-d30e967c3202 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:20.963660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-44e0b3f3-7f4c-41cf-bee5-d30e967c3202 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.238407 Jun 15 10:24:20.964240 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 644/1279] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:20 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:21.076900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-954f4935-aeab-45cd-95cc-17630f7a6491 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:21.084429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-954f4935-aeab-45cd-95cc-17630f7a6491 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.158721 Jun 15 10:24:21.084942 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 636/1280] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:20 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:21.987757 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6cb7360a-922e-4d46-8846-9c70cb2513f5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:21.988642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6cb7360a-922e-4d46-8846-9c70cb2513f5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:21.995136 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cb7360a-922e-4d46-8846-9c70cb2513f5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:21.995588 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cb7360a-922e-4d46-8846-9c70cb2513f5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:21.996467 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cb7360a-922e-4d46-8846-9c70cb2513f5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:21.996901 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cb7360a-922e-4d46-8846-9c70cb2513f5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:22.101216 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-863b67b4-8663-4761-b3ce-5b8389c813ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:22.102033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-863b67b4-8663-4761-b3ce-5b8389c813ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:22.109058 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-863b67b4-8663-4761-b3ce-5b8389c813ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:22.109587 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-863b67b4-8663-4761-b3ce-5b8389c813ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:22.110499 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-863b67b4-8663-4761-b3ce-5b8389c813ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:22.111005 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-863b67b4-8663-4761-b3ce-5b8389c813ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:22.252460 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6cb7360a-922e-4d46-8846-9c70cb2513f5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:22.259954 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6cb7360a-922e-4d46-8846-9c70cb2513f5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1366 microversion: 2.1 time: 0.276474 Jun 15 10:24:22.260520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 645/1281] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:21 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:22.366649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-863b67b4-8663-4761-b3ce-5b8389c813ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:22.374536 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-863b67b4-8663-4761-b3ce-5b8389c813ae tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.277116 Jun 15 10:24:22.375322 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 637/1282] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:22 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:23.276881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-22852fab-6817-4698-90f0-09e4f2c7682d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:23.277498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-22852fab-6817-4698-90f0-09e4f2c7682d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:23.284023 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22852fab-6817-4698-90f0-09e4f2c7682d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.284474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22852fab-6817-4698-90f0-09e4f2c7682d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.285229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22852fab-6817-4698-90f0-09e4f2c7682d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.285667 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-22852fab-6817-4698-90f0-09e4f2c7682d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.391741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5e190271-9d40-4859-826d-4b1cab4a2f50 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:23.392428 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5e190271-9d40-4859-826d-4b1cab4a2f50 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:23.398888 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e190271-9d40-4859-826d-4b1cab4a2f50 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.399333 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e190271-9d40-4859-826d-4b1cab4a2f50 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.400085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e190271-9d40-4859-826d-4b1cab4a2f50 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.400518 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5e190271-9d40-4859-826d-4b1cab4a2f50 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.415844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-22852fab-6817-4698-90f0-09e4f2c7682d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:23.423906 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-22852fab-6817-4698-90f0-09e4f2c7682d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1556 microversion: 2.1 time: 0.150352 Jun 15 10:24:23.424694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 646/1283] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:23 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:23.440730 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5ddc9246-60d9-4342-acb1-df8265f53a93 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:23.442734 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5ddc9246-60d9-4342-acb1-df8265f53a93 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:23.448825 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5ddc9246-60d9-4342-acb1-df8265f53a93 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.449299 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5ddc9246-60d9-4342-acb1-df8265f53a93 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.450104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5ddc9246-60d9-4342-acb1-df8265f53a93 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.450588 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5ddc9246-60d9-4342-acb1-df8265f53a93 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.552731 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5ddc9246-60d9-4342-acb1-df8265f53a93 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116542 Jun 15 10:24:23.553919 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 647/1284] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 10:24:23 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:24:23.572614 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-5e190271-9d40-4859-826d-4b1cab4a2f50 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:23.581209 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5e190271-9d40-4859-826d-4b1cab4a2f50 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.193273 Jun 15 10:24:23.581770 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 638/1285] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:23 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:24.498033 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-3d5eb574-8d8a-4f91-9b81-3e7dc63f7f16 req-e5f46927-4d3d-4f54-8070-b46dbdcd7a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa75463-37d9-41ab-a4bc-6e3b07aa318f", "tag": "73c7055c-4454-4744-8a62-7c4ff18bf4f8"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:24.506165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3d5eb574-8d8a-4f91-9b81-3e7dc63f7f16 req-e5f46927-4d3d-4f54-8070-b46dbdcd7a13 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:24.506669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-3d5eb574-8d8a-4f91-9b81-3e7dc63f7f16 req-e5f46927-4d3d-4f54-8070-b46dbdcd7a13 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:24.517739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-3d5eb574-8d8a-4f91-9b81-3e7dc63f7f16 req-e5f46927-4d3d-4f54-8070-b46dbdcd7a13 service nova] Creating event network-changed:73c7055c-4454-4744-8a62-7c4ff18bf4f8 for instance efa75463-37d9-41ab-a4bc-6e3b07aa318f on hv-cinder-83028 Jun 15 10:24:24.522852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-3d5eb574-8d8a-4f91-9b81-3e7dc63f7f16 req-e5f46927-4d3d-4f54-8070-b46dbdcd7a13 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084128 Jun 15 10:24:24.523642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 648/1286] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:24.597737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-c2f06106-004d-4c77-baca-b237949837b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:24.598476 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-c2f06106-004d-4c77-baca-b237949837b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:24.604802 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c2f06106-004d-4c77-baca-b237949837b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:24.605247 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c2f06106-004d-4c77-baca-b237949837b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:24.606214 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c2f06106-004d-4c77-baca-b237949837b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:24.606876 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-c2f06106-004d-4c77-baca-b237949837b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:24.848061 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-c2f06106-004d-4c77-baca-b237949837b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:24.856575 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-c2f06106-004d-4c77-baca-b237949837b4 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.263464 Jun 15 10:24:24.857184 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 639/1287] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:24 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:25.874287 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-949ee96e-d192-4e2b-9e07-58bd2501ef1f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:25.874930 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-949ee96e-d192-4e2b-9e07-58bd2501ef1f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:25.877170 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=4 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:25.877925 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=12 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:25.885226 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-949ee96e-d192-4e2b-9e07-58bd2501ef1f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:25.885675 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-949ee96e-d192-4e2b-9e07-58bd2501ef1f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:25.886476 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-949ee96e-d192-4e2b-9e07-58bd2501ef1f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:25.886916 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-949ee96e-d192-4e2b-9e07-58bd2501ef1f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:26.024358 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-949ee96e-d192-4e2b-9e07-58bd2501ef1f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:26.031781 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-949ee96e-d192-4e2b-9e07-58bd2501ef1f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.161708 Jun 15 10:24:26.032351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 649/1288] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:25 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:27.048899 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b454f20b-0ee2-4ecd-bec9-4b18d144bf37 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:27.050025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b454f20b-0ee2-4ecd-bec9-4b18d144bf37 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:27.051434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=8 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:27.057244 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b454f20b-0ee2-4ecd-bec9-4b18d144bf37 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.057698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b454f20b-0ee2-4ecd-bec9-4b18d144bf37 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.058498 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b454f20b-0ee2-4ecd-bec9-4b18d144bf37 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.058942 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b454f20b-0ee2-4ecd-bec9-4b18d144bf37 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.193680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b454f20b-0ee2-4ecd-bec9-4b18d144bf37 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:27.201080 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b454f20b-0ee2-4ecd-bec9-4b18d144bf37 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.156058 Jun 15 10:24:27.201638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 640/1289] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:27 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:28.218415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-20a51967-ee65-4d48-8adf-0b69573052f9 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:28.219032 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-20a51967-ee65-4d48-8adf-0b69573052f9 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:28.226169 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20a51967-ee65-4d48-8adf-0b69573052f9 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:28.226676 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20a51967-ee65-4d48-8adf-0b69573052f9 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:28.227553 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20a51967-ee65-4d48-8adf-0b69573052f9 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:28.228005 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-20a51967-ee65-4d48-8adf-0b69573052f9 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:28.359724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-20a51967-ee65-4d48-8adf-0b69573052f9 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:28.367246 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-20a51967-ee65-4d48-8adf-0b69573052f9 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.152953 Jun 15 10:24:28.367756 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 650/1290] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:28 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:29.383703 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-66de0cc0-2483-4fc6-90f7-91f3eb55c807 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:29.384315 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-66de0cc0-2483-4fc6-90f7-91f3eb55c807 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:29.390761 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-66de0cc0-2483-4fc6-90f7-91f3eb55c807 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:29.391213 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-66de0cc0-2483-4fc6-90f7-91f3eb55c807 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:29.391975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-66de0cc0-2483-4fc6-90f7-91f3eb55c807 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:29.392497 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-66de0cc0-2483-4fc6-90f7-91f3eb55c807 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:29.469620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-42a7724d-8f8a-48ae-af98-594535e66bc2 req-386ffed1-2a51-406c-a4c5-8333778247c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46d3605-3910-41a8-9a91-80edb73244d5", "name": "network-vif-plugged", "status": "completed", "tag": "05535f67-6da4-45e4-88ef-7dcce81df253"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:29.479291 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-42a7724d-8f8a-48ae-af98-594535e66bc2 req-386ffed1-2a51-406c-a4c5-8333778247c0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:29.479822 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-42a7724d-8f8a-48ae-af98-594535e66bc2 req-386ffed1-2a51-406c-a4c5-8333778247c0 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:29.492536 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-42a7724d-8f8a-48ae-af98-594535e66bc2 req-386ffed1-2a51-406c-a4c5-8333778247c0 service nova] Creating event network-vif-plugged:05535f67-6da4-45e4-88ef-7dcce81df253 for instance b46d3605-3910-41a8-9a91-80edb73244d5 on hv-cinder-83028 Jun 15 10:24:29.497334 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-42a7724d-8f8a-48ae-af98-594535e66bc2 req-386ffed1-2a51-406c-a4c5-8333778247c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087766 Jun 15 10:24:29.498022 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 651/1291] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:29.545505 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-66de0cc0-2483-4fc6-90f7-91f3eb55c807 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:29.554952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-66de0cc0-2483-4fc6-90f7-91f3eb55c807 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.175043 Jun 15 10:24:29.555465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 641/1292] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:29 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:30.572499 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b113712b-7855-412e-8b47-b303bd7cce5b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:30.573213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b113712b-7855-412e-8b47-b303bd7cce5b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:30.579477 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b113712b-7855-412e-8b47-b303bd7cce5b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:30.580856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b113712b-7855-412e-8b47-b303bd7cce5b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:30.581373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b113712b-7855-412e-8b47-b303bd7cce5b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:30.581821 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b113712b-7855-412e-8b47-b303bd7cce5b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:30.711150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-b113712b-7855-412e-8b47-b303bd7cce5b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:30.718571 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b113712b-7855-412e-8b47-b303bd7cce5b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1265 microversion: 2.1 time: 0.150867 Jun 15 10:24:30.719140 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 652/1293] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:30 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:31.736522 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-94d9bbfb-00d8-436e-8a69-b654f170e346 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:31.737446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-94d9bbfb-00d8-436e-8a69-b654f170e346 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:31.744247 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d9bbfb-00d8-436e-8a69-b654f170e346 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:31.744637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d9bbfb-00d8-436e-8a69-b654f170e346 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:31.745396 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d9bbfb-00d8-436e-8a69-b654f170e346 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:31.745833 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94d9bbfb-00d8-436e-8a69-b654f170e346 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:31.876663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-94d9bbfb-00d8-436e-8a69-b654f170e346 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:31.884090 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-94d9bbfb-00d8-436e-8a69-b654f170e346 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1450 microversion: 2.1 time: 0.152137 Jun 15 10:24:31.884688 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 642/1294] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:31 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:31.900216 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-2a4d2e38-862e-47c0-9fa3-81fe9dd9a570 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:31.900860 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-2a4d2e38-862e-47c0-9fa3-81fe9dd9a570 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:31.907323 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a4d2e38-862e-47c0-9fa3-81fe9dd9a570 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:31.908264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a4d2e38-862e-47c0-9fa3-81fe9dd9a570 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:31.909519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a4d2e38-862e-47c0-9fa3-81fe9dd9a570 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:31.909964 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-2a4d2e38-862e-47c0-9fa3-81fe9dd9a570 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:32.052044 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-2a4d2e38-862e-47c0-9fa3-81fe9dd9a570 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:32.059531 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-2a4d2e38-862e-47c0-9fa3-81fe9dd9a570 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1450 microversion: 2.1 time: 0.163152 Jun 15 10:24:32.060099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 653/1295] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:31 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:33.969125 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-1b0610c4-80c3-47a7-ba03-0f56ac3ac59e req-475adac2-7790-4802-9445-1400f342048a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46d3605-3910-41a8-9a91-80edb73244d5", "tag": "05535f67-6da4-45e4-88ef-7dcce81df253"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:33.979177 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-1b0610c4-80c3-47a7-ba03-0f56ac3ac59e req-475adac2-7790-4802-9445-1400f342048a service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:33.979627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-1b0610c4-80c3-47a7-ba03-0f56ac3ac59e req-475adac2-7790-4802-9445-1400f342048a service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:33.990493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-1b0610c4-80c3-47a7-ba03-0f56ac3ac59e req-475adac2-7790-4802-9445-1400f342048a service nova] Creating event network-changed:05535f67-6da4-45e4-88ef-7dcce81df253 for instance b46d3605-3910-41a8-9a91-80edb73244d5 on hv-cinder-83028 Jun 15 10:24:33.996052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-1b0610c4-80c3-47a7-ba03-0f56ac3ac59e req-475adac2-7790-4802-9445-1400f342048a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030202 Jun 15 10:24:33.996052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 643/1296] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:09.308468 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dc3450ea-7d79-4b97-aee1-fe77018f3346 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:09.309071 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dc3450ea-7d79-4b97-aee1-fe77018f3346 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:09.311332 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=29 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:09.311982 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=98 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:09.318646 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc3450ea-7d79-4b97-aee1-fe77018f3346 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:09.319099 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc3450ea-7d79-4b97-aee1-fe77018f3346 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:09.320794 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc3450ea-7d79-4b97-aee1-fe77018f3346 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:09.321239 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dc3450ea-7d79-4b97-aee1-fe77018f3346 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:09.345146 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dc3450ea-7d79-4b97-aee1-fe77018f3346 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/ips" status: 200 len: 145 microversion: 2.1 time: 0.040605 Jun 15 10:25:09.345639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 654/1297] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:25:09 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:10.661254 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=21 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:10.662018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=47 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:10.667041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8f0b1d45-7a18-4b73-9835-364a3e214082 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6599af9e-b04a-4f40-934d-43098acaf68d"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:10.668190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8f0b1d45-7a18-4b73-9835-364a3e214082 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:10.675123 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8f0b1d45-7a18-4b73-9835-364a3e214082 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:10.675573 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8f0b1d45-7a18-4b73-9835-364a3e214082 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:10.676328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8f0b1d45-7a18-4b73-9835-364a3e214082 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:10.676765 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8f0b1d45-7a18-4b73-9835-364a3e214082 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:10.939823 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8f0b1d45-7a18-4b73-9835-364a3e214082 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279982 Jun 15 10:25:10.940448 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 644/1298] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:25:10 2022] POST /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:25:18.430714 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-defc8a3f-65c4-4b5e-a39b-38955f99244d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:18.431719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-defc8a3f-65c4-4b5e-a39b-38955f99244d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:18.438435 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-defc8a3f-65c4-4b5e-a39b-38955f99244d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.438898 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-defc8a3f-65c4-4b5e-a39b-38955f99244d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.439664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-defc8a3f-65c4-4b5e-a39b-38955f99244d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.440107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-defc8a3f-65c4-4b5e-a39b-38955f99244d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.468847 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-defc8a3f-65c4-4b5e-a39b-38955f99244d tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Jun 15 10:25:18.469388 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 655/1299] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:25:18 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:18.480894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-24d7dbcb-c341-4fb7-b6d7-14754aadf22e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:18.481497 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-24d7dbcb-c341-4fb7-b6d7-14754aadf22e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:18.487859 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24d7dbcb-c341-4fb7-b6d7-14754aadf22e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.488310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24d7dbcb-c341-4fb7-b6d7-14754aadf22e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.489070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24d7dbcb-c341-4fb7-b6d7-14754aadf22e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.489513 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-24d7dbcb-c341-4fb7-b6d7-14754aadf22e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.518661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-24d7dbcb-c341-4fb7-b6d7-14754aadf22e tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/6599af9e-b04a-4f40-934d-43098acaf68d" status: 200 len: 194 microversion: 2.1 time: 0.043046 Jun 15 10:25:18.519236 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 645/1300] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Jun 15 10:25:18 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/6599af9e-b04a-4f40-934d-43098acaf68d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:25:19.829702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9001abf6-575a-4d31-b747-44687109fa45 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1415223-168f-4884-a95b-8b9abeb0cb15"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:19.830836 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-9001abf6-575a-4d31-b747-44687109fa45 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:19.837481 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9001abf6-575a-4d31-b747-44687109fa45 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:19.837940 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9001abf6-575a-4d31-b747-44687109fa45 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:19.838748 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9001abf6-575a-4d31-b747-44687109fa45 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:19.839214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-9001abf6-575a-4d31-b747-44687109fa45 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:20.093993 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9001abf6-575a-4d31-b747-44687109fa45 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "POST /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268162 Jun 15 10:25:20.094809 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 656/1301] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:25:19 2022] POST /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:23.568196 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-8b278439-7133-4b6d-87db-720838c6d94f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:23.569172 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-8b278439-7133-4b6d-87db-720838c6d94f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:23.575746 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b278439-7133-4b6d-87db-720838c6d94f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.576196 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b278439-7133-4b6d-87db-720838c6d94f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.576952 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b278439-7133-4b6d-87db-720838c6d94f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.577388 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-8b278439-7133-4b6d-87db-720838c6d94f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.605769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-8b278439-7133-4b6d-87db-720838c6d94f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041512 Jun 15 10:25:23.606343 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 646/1302] 10.222.0.57 () {60 vars in 1342 bytes} [Wed Jun 15 10:25:23 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:23.662849 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b2349078-0a86-4336-9a49-e6ca6aaef41f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:23.663440 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b2349078-0a86-4336-9a49-e6ca6aaef41f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:23.670763 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b2349078-0a86-4336-9a49-e6ca6aaef41f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.671218 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b2349078-0a86-4336-9a49-e6ca6aaef41f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.671986 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b2349078-0a86-4336-9a49-e6ca6aaef41f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.672429 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b2349078-0a86-4336-9a49-e6ca6aaef41f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.697301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b2349078-0a86-4336-9a49-e6ca6aaef41f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:25:23.769712 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b2349078-0a86-4336-9a49-e6ca6aaef41f tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 204 len: 0 microversion: 2.20 time: 0.110857 Jun 15 10:25:23.770747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 657/1303] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Jun 15 10:25:23 2022] DELETE /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:25:23.779680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:23.780333 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:23.786368 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.786828 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.787611 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.788038 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.937531 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:23.945690 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:23.947234 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:23.948398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9b51936c-6278-457b-941f-50f76de25257 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.172645 Jun 15 10:25:23.948969 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 647/1304] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:25:23 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:24.966684 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:24.967395 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:24.974165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:24.974617 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:24.975372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:24.975807 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:25.106288 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:25.114180 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:25.115747 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:25.116902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-12b1f33d-bd39-4c3b-a292-0c04425c77dc tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1723 microversion: 2.20 time: 0.154635 Jun 15 10:25:25.118131 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 658/1305] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:25:24 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:25:26.136703 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:26.137317 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:26.143747 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:26.144206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:26.145065 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:26.145507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:26.243251 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:26.254862 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:26.254862 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:26.256059 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-58050bfb-59ee-436b-b1a6-14a8d15b0d95 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1656 microversion: 2.20 time: 0.123828 Jun 15 10:25:26.266984 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 648/1306] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:25:26 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1656 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:26.531977 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-9bdbb78b-a9f7-4321-b397-3d2a282adb49 req-b962abfb-2622-4932-b96a-c3c1648d974f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3", "name": "network-vif-deleted", "tag": "132b131d-7c10-4f96-96c1-cc640e8d71a7"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:26.541008 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-9bdbb78b-a9f7-4321-b397-3d2a282adb49 req-b962abfb-2622-4932-b96a-c3c1648d974f service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:26.541463 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-9bdbb78b-a9f7-4321-b397-3d2a282adb49 req-b962abfb-2622-4932-b96a-c3c1648d974f service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:26.552926 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-9bdbb78b-a9f7-4321-b397-3d2a282adb49 req-b962abfb-2622-4932-b96a-c3c1648d974f service nova] Creating event network-vif-deleted:132b131d-7c10-4f96-96c1-cc640e8d71a7 for instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 on hv-cinder-83028 Jun 15 10:25:26.559036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-9bdbb78b-a9f7-4321-b397-3d2a282adb49 req-b962abfb-2622-4932-b96a-c3c1648d974f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030361 Jun 15 10:25:26.560302 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 659/1307] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:27.275864 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:27.276728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:27.283146 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:27.283596 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:27.284379 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:27.284815 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:27.318699 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:27.319155 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:27.319613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lazy-loading 'fault' on Instance uuid dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:25:27.368582 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:27.377255 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:27.378799 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '021e68642b0d4384bf3ece64e8e2ad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30e2cce69fb4e9bba7c053c4a37ba07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:27.380004 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0128d9b4-5169-4bf6-acad-90bafe5a8041 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 200 len: 1372 microversion: 2.20 time: 0.109304 Jun 15 10:25:27.380562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 649/1308] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:25:27 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:28.400364 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:28.401074 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:28.407384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.407858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.408625 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.409067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.422543 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] HTTP exception thrown: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Request method failure captured: Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 HTTP/1.1 Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDTIqMqN40B5fLpN7fbdtXu8mBUJrYw096JtCI8GCBR5Cl8ZpYNzjwDWf7MCR0-ZLWhrOKhct60o_YJX2-UGhwMyAaUq5SFiyWFTpwSsBhwMhHrzA3asy8GlEITk0bsoIN6Ud6D0W-Fj3e3O--ByX8Jn6i6dE4vOGrirc1HRskthU8 Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:25:28.424167 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f30e2cce69fb4e9bba7c053c4a37ba07", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 021e68642b0d4384bf3ece64e8e2ad69 Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:28.425934 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': 'dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3'} Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:28.426913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:28.428505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:28.430580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Returning 404 to user: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:28.430580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-028e01da-1646-4aab-8494-fd7be88e4696 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 404 len: 111 microversion: 2.20 time: 0.030387 Jun 15 10:25:28.430580 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 660/1309] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:25:28 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:25:28.435173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-671310e4-484d-4dd0-b541-40f4176ee31c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '.version_select at 0x7fe256174280>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:28.452680 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-671310e4-484d-4dd0-b541-40f4176ee31c tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349756906" status: 204 len: 0 microversion: 2.20 time: 0.021238 Jun 15 10:25:28.453309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 650/1310] 10.222.0.57 () {60 vars in 1261 bytes} [Wed Jun 15 10:25:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349756906 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:25:28.661025 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-aab34765-ae10-42e0-a078-8ebc17ad2086 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:28.661970 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-aab34765-ae10-42e0-a078-8ebc17ad2086 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:28.668844 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aab34765-ae10-42e0-a078-8ebc17ad2086 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.669305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aab34765-ae10-42e0-a078-8ebc17ad2086 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.670077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aab34765-ae10-42e0-a078-8ebc17ad2086 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.670547 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-aab34765-ae10-42e0-a078-8ebc17ad2086 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.702898 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-aab34765-ae10-42e0-a078-8ebc17ad2086 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045732 Jun 15 10:25:28.703462 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 661/1311] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:25:28 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:28.803274 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-518370ab-be51-4b5c-8805-95ff4a5824ac tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:28.803880 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-518370ab-be51-4b5c-8805-95ff4a5824ac tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:28.810780 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-518370ab-be51-4b5c-8805-95ff4a5824ac tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.811314 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-518370ab-be51-4b5c-8805-95ff4a5824ac tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.812161 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-518370ab-be51-4b5c-8805-95ff4a5824ac tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.812709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-518370ab-be51-4b5c-8805-95ff4a5824ac tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.841950 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-518370ab-be51-4b5c-8805-95ff4a5824ac tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/6599af9e-b04a-4f40-934d-43098acaf68d" status: 200 len: 194 microversion: 2.1 time: 0.042743 Jun 15 10:25:28.842609 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 651/1312] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Jun 15 10:25:28 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/6599af9e-b04a-4f40-934d-43098acaf68d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:28.853130 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ca58cecb-88b4-40dd-bcf8-f8a00c5b873f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:28.853620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ca58cecb-88b4-40dd-bcf8-f8a00c5b873f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:28.859532 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ca58cecb-88b4-40dd-bcf8-f8a00c5b873f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.859976 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ca58cecb-88b4-40dd-bcf8-f8a00c5b873f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.860731 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ca58cecb-88b4-40dd-bcf8-f8a00c5b873f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.861162 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ca58cecb-88b4-40dd-bcf8-f8a00c5b873f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.943036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-ca58cecb-88b4-40dd-bcf8-f8a00c5b873f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lazy-loading 'services' on Instance uuid 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:25:29.016891 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ca58cecb-88b4-40dd-bcf8-f8a00c5b873f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/6599af9e-b04a-4f40-934d-43098acaf68d" status: 202 len: 0 microversion: 2.1 time: 0.168200 Jun 15 10:25:29.017485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 662/1313] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:25:28 2022] DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/6599af9e-b04a-4f40-934d-43098acaf68d => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:25:30.243372 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:30.243873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:30.250438 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:30.250919 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:30.251690 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:30.252124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:30.265156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] HTTP exception thrown: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Request method failure captured: Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 HTTP/1.1 Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDTIqMqN40B5fLpN7fbdtXu8mBUJrYw096JtCI8GCBR5Cl8ZpYNzjwDWf7MCR0-ZLWhrOKhct60o_YJX2-UGhwMyAaUq5SFiyWFTpwSsBhwMhHrzA3asy8GlEITk0bsoIN6Ud6D0W-Fj3e3O--ByX8Jn6i6dE4vOGrirc1HRskthU8 Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:25:30.266855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f30e2cce69fb4e9bba7c053c4a37ba07", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 021e68642b0d4384bf3ece64e8e2ad69 Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.268472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3'} Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:30.269349 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.270810 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.272811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Returning 404 to user: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:30.272811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-bac8ade5-8964-4cbb-b27c-88fd139297ef tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "DELETE /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 404 len: 111 microversion: 2.20 time: 0.029438 Jun 15 10:25:30.272811 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 652/1314] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Jun 15 10:25:30 2022] DELETE /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:25:30.277931 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:30.278691 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:30.285053 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:30.285694 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:30.286571 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:30.287014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:30.300701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] HTTP exception thrown: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Request method failure captured: Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 HTTP/1.1 Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDTIqMqN40B5fLpN7fbdtXu8mBUJrYw096JtCI8GCBR5Cl8ZpYNzjwDWf7MCR0-ZLWhrOKhct60o_YJX2-UGhwMyAaUq5SFiyWFTpwSsBhwMhHrzA3asy8GlEITk0bsoIN6Ud6D0W-Fj3e3O--ByX8Jn6i6dE4vOGrirc1HRskthU8 Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:25:30.302373 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f30e2cce69fb4e9bba7c053c4a37ba07", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 021e68642b0d4384bf3ece64e8e2ad69 Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.304027 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': 'dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3'} Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:30.305572 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. Jun 15 10:25:30.307059 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:30.308313 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Returning 404 to user: Instance dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:30.308313 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5e7c66af-c4b1-4c8b-b2a4-c1ff70dcff6a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3" status: 404 len: 111 microversion: 2.20 time: 0.030637 Jun 15 10:25:30.308313 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 663/1315] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:25:30 2022] GET /compute/v2.1/servers/dc0eff4a-d3af-49ac-9a1b-f5ab84d227b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:25:31.190001 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ae16c05c-6468-46fa-88d1-f74e5a175690 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:31.190525 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ae16c05c-6468-46fa-88d1-f74e5a175690 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:31.196975 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae16c05c-6468-46fa-88d1-f74e5a175690 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.197425 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae16c05c-6468-46fa-88d1-f74e5a175690 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.198190 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae16c05c-6468-46fa-88d1-f74e5a175690 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.198658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ae16c05c-6468-46fa-88d1-f74e5a175690 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.227156 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ae16c05c-6468-46fa-88d1-f74e5a175690 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/b1415223-168f-4884-a95b-8b9abeb0cb15" status: 200 len: 194 microversion: 2.1 time: 0.041138 Jun 15 10:25:31.227723 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 653/1316] 10.222.0.57 () {58 vars in 1412 bytes} [Wed Jun 15 10:25:31 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/b1415223-168f-4884-a95b-8b9abeb0cb15 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:31.237471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-716b7969-b6a4-4f41-9858-d77fc1fe6e40 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:31.237960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-716b7969-b6a4-4f41-9858-d77fc1fe6e40 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:31.244507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-716b7969-b6a4-4f41-9858-d77fc1fe6e40 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.244953 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-716b7969-b6a4-4f41-9858-d77fc1fe6e40 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.245706 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-716b7969-b6a4-4f41-9858-d77fc1fe6e40 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.246143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-716b7969-b6a4-4f41-9858-d77fc1fe6e40 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.325310 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-716b7969-b6a4-4f41-9858-d77fc1fe6e40 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lazy-loading 'services' on Instance uuid 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:25:31.395511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-716b7969-b6a4-4f41-9858-d77fc1fe6e40 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/b1415223-168f-4884-a95b-8b9abeb0cb15" status: 202 len: 0 microversion: 2.1 time: 0.162031 Jun 15 10:25:31.396096 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 664/1317] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:25:31 2022] DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments/b1415223-168f-4884-a95b-8b9abeb0cb15 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:25:31.446373 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:31.446903 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:31.454435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.454435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.454634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.454899 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.469118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] HTTP exception thrown: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Request method failure captured: Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 HTTP/1.1 Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbDTIqMqN40B5fLpN7fbdtXu8mBUJrYw096JtCI8GCBR5Cl8ZpYNzjwDWf7MCR0-ZLWhrOKhct60o_YJX2-UGhwMyAaUq5SFiyWFTpwSsBhwMhHrzA3asy8GlEITk0bsoIN6Ud6D0W-Fj3e3O--ByX8Jn6i6dE4vOGrirc1HRskthU8 Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:25:31.470709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f30e2cce69fb4e9bba7c053c4a37ba07", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 021e68642b0d4384bf3ece64e8e2ad69 Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.472661 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'af5ab626-a7eb-407e-b8a9-a768e57d4022'} Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:31.473702 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.475298 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.477007 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Returning 404 to user: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:31.477007 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6b652c7c-bcdf-4593-82ce-69832dd05b9a tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "DELETE /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 404 len: 111 microversion: 2.20 time: 0.030976 Jun 15 10:25:31.477007 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 654/1318] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Jun 15 10:25:31 2022] DELETE /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:25:31.481413 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:31.482126 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] [instance: af5ab626-a7eb-407e-b8a9-a768e57d4022] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:31.490473 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.491015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.491881 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.492914 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.506415 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] HTTP exception thrown: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Request method failure captured: Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 HTTP/1.1 Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbDTIqMqN40B5fLpN7fbdtXu8mBUJrYw096JtCI8GCBR5Cl8ZpYNzjwDWf7MCR0-ZLWhrOKhct60o_YJX2-UGhwMyAaUq5SFiyWFTpwSsBhwMhHrzA3asy8GlEITk0bsoIN6Ud6D0W-Fj3e3O--ByX8Jn6i6dE4vOGrirc1HRskthU8 Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:25:31.508669 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f30e2cce69fb4e9bba7c053c4a37ba07", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f30e2cce69fb4e9bba7c053c4a37ba07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: f30e2cce69fb4e9bba7c053c4a37ba07 Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1478292163 Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 021e68642b0d4384bf3ece64e8e2ad69 Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1478292163-project Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.510376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': 'af5ab626-a7eb-407e-b8a9-a768e57d4022'} Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:31.511283 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. Jun 15 10:25:31.512587 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:31.513683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] Returning 404 to user: Instance af5ab626-a7eb-407e-b8a9-a768e57d4022 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:31.513683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e1b236e9-4923-4061-9712-7075f984f0c4 tempest-AttachVolumeShelveTestJSON-1478292163 tempest-AttachVolumeShelveTestJSON-1478292163-project] 10.222.0.57 "GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022" status: 404 len: 111 microversion: 2.20 time: 0.032968 Jun 15 10:25:31.513683 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 665/1319] 10.222.0.57 () {60 vars in 1276 bytes} [Wed Jun 15 10:25:31 2022] GET /compute/v2.1/servers/af5ab626-a7eb-407e-b8a9-a768e57d4022 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:25:32.569326 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-90af6e63-36b3-498d-a1ab-6473568a2a10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:32.570336 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-90af6e63-36b3-498d-a1ab-6473568a2a10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:32.577700 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90af6e63-36b3-498d-a1ab-6473568a2a10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:32.578033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90af6e63-36b3-498d-a1ab-6473568a2a10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:32.578848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90af6e63-36b3-498d-a1ab-6473568a2a10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:32.579286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90af6e63-36b3-498d-a1ab-6473568a2a10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:32.612837 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-90af6e63-36b3-498d-a1ab-6473568a2a10 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047269 Jun 15 10:25:32.616008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 655/1320] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:25:32 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:25:32.730170 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5622ed57-0a67-4cea-b957-18d565c5b53c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:32.731189 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5622ed57-0a67-4cea-b957-18d565c5b53c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:32.737639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5622ed57-0a67-4cea-b957-18d565c5b53c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:32.738036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5622ed57-0a67-4cea-b957-18d565c5b53c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:32.738854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5622ed57-0a67-4cea-b957-18d565c5b53c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:32.739300 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5622ed57-0a67-4cea-b957-18d565c5b53c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:32.769584 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5622ed57-0a67-4cea-b957-18d565c5b53c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043935 Jun 15 10:25:32.775328 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 666/1321] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:25:32 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:25:32.827507 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0fae520f-0bcb-40f5-9ce1-d4bc21c5803c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:32.828002 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0fae520f-0bcb-40f5-9ce1-d4bc21c5803c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:32.833919 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fae520f-0bcb-40f5-9ce1-d4bc21c5803c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:32.834398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fae520f-0bcb-40f5-9ce1-d4bc21c5803c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:32.835158 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fae520f-0bcb-40f5-9ce1-d4bc21c5803c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:32.835591 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0fae520f-0bcb-40f5-9ce1-d4bc21c5803c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:32.861544 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0fae520f-0bcb-40f5-9ce1-d4bc21c5803c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:25:32.945075 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0fae520f-0bcb-40f5-9ce1-d4bc21c5803c tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 204 len: 0 microversion: 2.1 time: 0.120920 Jun 15 10:25:32.946041 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 656/1322] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:25:32 2022] DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:25:32.954242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-24c74d74-843e-4293-9a97-9269dd0e1154 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:32.954879 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-24c74d74-843e-4293-9a97-9269dd0e1154 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:32.961687 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24c74d74-843e-4293-9a97-9269dd0e1154 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:32.962138 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24c74d74-843e-4293-9a97-9269dd0e1154 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:32.962947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24c74d74-843e-4293-9a97-9269dd0e1154 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:32.963388 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-24c74d74-843e-4293-9a97-9269dd0e1154 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:33.331639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-24c74d74-843e-4293-9a97-9269dd0e1154 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:33.339614 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-24c74d74-843e-4293-9a97-9269dd0e1154 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1672 microversion: 2.1 time: 0.389234 Jun 15 10:25:33.340200 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 667/1323] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:32 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1672 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:34.358774 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-90359e89-5201-44fd-9079-711268568903 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:34.360275 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-90359e89-5201-44fd-9079-711268568903 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:34.371371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90359e89-5201-44fd-9079-711268568903 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:34.372074 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90359e89-5201-44fd-9079-711268568903 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:34.372867 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90359e89-5201-44fd-9079-711268568903 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:34.373307 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-90359e89-5201-44fd-9079-711268568903 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:34.511199 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-90359e89-5201-44fd-9079-711268568903 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:34.519688 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-90359e89-5201-44fd-9079-711268568903 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1672 microversion: 2.1 time: 0.165316 Jun 15 10:25:34.520273 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 657/1324] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:34 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:35.540379 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-c4450435-9be8-4c60-a214-52583856add7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:35.541095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-c4450435-9be8-4c60-a214-52583856add7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:35.548782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4450435-9be8-4c60-a214-52583856add7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:35.549239 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4450435-9be8-4c60-a214-52583856add7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:35.550075 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4450435-9be8-4c60-a214-52583856add7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:35.550578 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-c4450435-9be8-4c60-a214-52583856add7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:35.769838 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-c4450435-9be8-4c60-a214-52583856add7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:35.778016 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-c4450435-9be8-4c60-a214-52583856add7 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1672 microversion: 2.1 time: 0.244692 Jun 15 10:25:35.778883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 668/1325] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:35 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1672 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:36.366669 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-80387940-fc8d-4b8b-b134-5b8ef236d829 req-1cc70e69-a0ff-4c96-aef3-d5f625801283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4b1e80-69d7-45d7-8f5c-875bfc36c14a", "name": "network-vif-deleted", "tag": "ce351867-bf25-4b16-bacb-b029aee23d0f"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:36.378735 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-80387940-fc8d-4b8b-b134-5b8ef236d829 req-1cc70e69-a0ff-4c96-aef3-d5f625801283 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:36.379290 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-80387940-fc8d-4b8b-b134-5b8ef236d829 req-1cc70e69-a0ff-4c96-aef3-d5f625801283 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:36.394731 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-80387940-fc8d-4b8b-b134-5b8ef236d829 req-1cc70e69-a0ff-4c96-aef3-d5f625801283 service nova] Creating event network-vif-deleted:ce351867-bf25-4b16-bacb-b029aee23d0f for instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a on hv-cinder-83028 Jun 15 10:25:36.401196 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-80387940-fc8d-4b8b-b134-5b8ef236d829 req-1cc70e69-a0ff-4c96-aef3-d5f625801283 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041389 Jun 15 10:25:36.401832 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 658/1326] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:25:36.794688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:36.795498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:36.802096 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:36.802673 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:36.803520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:36.804052 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:36.808898 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:36.841717 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:36.842289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:36.842831 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lazy-loading 'fault' on Instance uuid 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:25:36.891085 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04041aca6d64274b7019fcd6ece608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b6b134fac8433db72a937ba72e8a6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:36.899106 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7919fc12-938d-4410-bb25-11cf6403f47b tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 200 len: 1327 microversion: 2.1 time: 0.108396 Jun 15 10:25:36.899688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 669/1327] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:36 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:37.917423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:37.918118 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:37.925574 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:37.926028 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:37.926842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:37.927286 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:37.940687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] HTTP exception thrown: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Request method failure captured: Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a HTTP/1.1 Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbFGODjpC2ugniq1XIB7CYnjt4TP76OBs5BeVEicAufM5sEQjGc6sS3wlxOf42D8QqI2YqND43ywc_6aG5wFqu17AshexrZdU09ZL9-z-hZknUuIW-q1GKEg_QG__08O5mktp1s6C2RK1HoYr6hEPkexL0s_7ZlCx9AXsW4Bb9BH1vI Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:25:37.942310 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36b6b134fac8433db72a937ba72e8a6c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: a04041aca6d64274b7019fcd6ece608c Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:37.944049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '8a4b1e80-69d7-45d7-8f5c-875bfc36c14a'} Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:37.945548 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:37.946947 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:37.948077 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Returning 404 to user: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:37.948077 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-5f794d6e-043c-45b7-8aee-269875180d2a tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 404 len: 111 microversion: 2.1 time: 0.031103 Jun 15 10:25:37.948077 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 659/1328] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:37 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:25:37.953361 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-9df5d5b2-762e-4e51-9013-ce973ce0bfdd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '.version_select at 0x7fe2562109d0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:37.971771 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-9df5d5b2-762e-4e51-9013-ce973ce0bfdd tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-819423793" status: 202 len: 0 microversion: 2.1 time: 0.022250 Jun 15 10:25:37.972320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 670/1329] 10.222.0.57 () {58 vars in 1217 bytes} [Wed Jun 15 10:25:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-819423793 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:25:40.882878 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:40.883359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:40.885854 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:40.891213 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:40.891666 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:40.892426 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:40.892864 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:40.897752 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:40.909500 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] HTTP exception thrown: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Request method failure captured: Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a HTTP/1.1 Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbFGODjpC2ugniq1XIB7CYnjt4TP76OBs5BeVEicAufM5sEQjGc6sS3wlxOf42D8QqI2YqND43ywc_6aG5wFqu17AshexrZdU09ZL9-z-hZknUuIW-q1GKEg_QG__08O5mktp1s6C2RK1HoYr6hEPkexL0s_7ZlCx9AXsW4Bb9BH1vI Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:25:40.911277 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36b6b134fac8433db72a937ba72e8a6c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: a04041aca6d64274b7019fcd6ece608c Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.912861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '8a4b1e80-69d7-45d7-8f5c-875bfc36c14a'} Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:40.914259 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.915842 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.917559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Returning 404 to user: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:40.917559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-093939d0-0075-4633-9cf1-c7919928aae1 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 404 len: 111 microversion: 2.1 time: 0.033792 Jun 15 10:25:40.917559 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 660/1330] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:25:40 2022] DELETE /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:25:40.922519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:40.923528 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:40.926103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:40.933642 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:40.934103 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:40.934915 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:40.935362 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:40.949651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] HTTP exception thrown: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Request method failure captured: Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a HTTP/1.1 Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbFGODjpC2ugniq1XIB7CYnjt4TP76OBs5BeVEicAufM5sEQjGc6sS3wlxOf42D8QqI2YqND43ywc_6aG5wFqu17AshexrZdU09ZL9-z-hZknUuIW-q1GKEg_QG__08O5mktp1s6C2RK1HoYr6hEPkexL0s_7ZlCx9AXsW4Bb9BH1vI Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:25:40.951220 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36b6b134fac8433db72a937ba72e8a6c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: a04041aca6d64274b7019fcd6ece608c Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.952905 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '8a4b1e80-69d7-45d7-8f5c-875bfc36c14a'} Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:40.953740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. Jun 15 10:25:40.955242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:40.956657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Returning 404 to user: Instance 8a4b1e80-69d7-45d7-8f5c-875bfc36c14a could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:40.956657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-81677af0-35b0-4631-a4b0-eb67b01d5ac8 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a" status: 404 len: 111 microversion: 2.1 time: 0.034814 Jun 15 10:25:40.956657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 671/1331] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:40 2022] GET /compute/v2.1/servers/8a4b1e80-69d7-45d7-8f5c-875bfc36c14a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:25:46.278400 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:46.278914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:46.287119 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:46.287572 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:46.288345 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:46.288786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:46.302913 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] HTTP exception thrown: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Request method failure captured: Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: DELETE /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 HTTP/1.1 Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbFGODjpC2ugniq1XIB7CYnjt4TP76OBs5BeVEicAufM5sEQjGc6sS3wlxOf42D8QqI2YqND43ywc_6aG5wFqu17AshexrZdU09ZL9-z-hZknUuIW-q1GKEg_QG__08O5mktp1s6C2RK1HoYr6hEPkexL0s_7ZlCx9AXsW4Bb9BH1vI Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:25:46.304435 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36b6b134fac8433db72a937ba72e8a6c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: a04041aca6d64274b7019fcd6ece608c Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.306420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '7367c589-27eb-4ff0-860e-d6a676c70441'} Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:46.308056 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.310033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.312024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Returning 404 to user: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:46.312024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-861dddbb-0534-4f62-b95c-60c5c33ece23 tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 404 len: 111 microversion: 2.1 time: 0.032011 Jun 15 10:25:46.312024 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 661/1332] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:25:46 2022] DELETE /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:25:46.315848 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:46.316465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] [instance: 7367c589-27eb-4ff0-860e-d6a676c70441] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:46.323310 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:46.323761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:46.324526 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:46.324962 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:46.338641 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] HTTP exception thrown: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Request method failure captured: Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 HTTP/1.1 Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbFGODjpC2ugniq1XIB7CYnjt4TP76OBs5BeVEicAufM5sEQjGc6sS3wlxOf42D8QqI2YqND43ywc_6aG5wFqu17AshexrZdU09ZL9-z-hZknUuIW-q1GKEg_QG__08O5mktp1s6C2RK1HoYr6hEPkexL0s_7ZlCx9AXsW4Bb9BH1vI Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:25:46.340143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_36b6b134fac8433db72a937ba72e8a6c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/36b6b134fac8433db72a937ba72e8a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 36b6b134fac8433db72a937ba72e8a6c Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1637972072 Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: a04041aca6d64274b7019fcd6ece608c Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeTestJSON-1637972072-project Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.341788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '7367c589-27eb-4ff0-860e-d6a676c70441'} Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:46.342726 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. Jun 15 10:25:46.344202 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:25:46.345552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] Returning 404 to user: Instance 7367c589-27eb-4ff0-860e-d6a676c70441 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:46.345552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5cf73315-9cab-43af-935d-20c709ef612f tempest-AttachVolumeTestJSON-1637972072 tempest-AttachVolumeTestJSON-1637972072-project] 10.222.0.57 "GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441" status: 404 len: 111 microversion: 2.1 time: 0.029548 Jun 15 10:25:46.345552 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 672/1333] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:46 2022] GET /compute/v2.1/servers/7367c589-27eb-4ff0-860e-d6a676c70441 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:26:06.642047 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-eef88adb-c1fd-4df0-8a7b-8f8cafbc7973 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:06.642047 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-eef88adb-c1fd-4df0-8a7b-8f8cafbc7973 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:06.643324 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=3 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:06.643969 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=3 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:06.649820 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eef88adb-c1fd-4df0-8a7b-8f8cafbc7973 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.650295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eef88adb-c1fd-4df0-8a7b-8f8cafbc7973 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.651557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eef88adb-c1fd-4df0-8a7b-8f8cafbc7973 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.651994 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-eef88adb-c1fd-4df0-8a7b-8f8cafbc7973 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.675062 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-eef88adb-c1fd-4df0-8a7b-8f8cafbc7973 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f/ips" status: 200 len: 150 microversion: 2.1 time: 0.038179 Jun 15 10:26:06.675616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 662/1334] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:26:06 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:06.685996 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f835de01-aa74-4e80-a0a2-4f022b20354f"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:06.687097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:06.689054 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:06.689702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=10 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:06.695961 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.696419 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.697186 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.697637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.782722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Invalid volume: volume f835de01-aa74-4e80-a0a2-4f022b20354f is already attached to instances: 2b0c2e15-868c-49a1-8464-4ef339043aae Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: POST /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f/os-volume_attachments HTTP/1.1 Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 74 Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:26:06.784561 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {"volumeAttachment": {"volumeId": "f835de01-aa74-4e80-a0a2-4f022b20354f"}} Jun 15 10:26:06.786150 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Invalid volume: volume f835de01-aa74-4e80-a0a2-4f022b20354f is already attached to instances: 2b0c2e15-868c-49a1-8464-4ef339043aae Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'server_id': 'efa75463-37d9-41ab-a4bc-6e3b07aa318f', 'body': {'volumeAttachment': {'volumeId': 'f835de01-aa74-4e80-a0a2-4f022b20354f'}}} Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f835de01-aa74-4e80-a0a2-4f022b20354f is already attached to instances: 2b0c2e15-868c-49a1-8464-4ef339043aae Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:06.787229 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f835de01-aa74-4e80-a0a2-4f022b20354f is already attached to instances: 2b0c2e15-868c-49a1-8464-4ef339043aae Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:06.793060 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:06.794603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:06.794603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:26:06.794603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:26:06.794603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f835de01-aa74-4e80-a0a2-4f022b20354f is already attached to instances: 2b0c2e15-868c-49a1-8464-4ef339043aae Jun 15 10:26:06.794603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:06.794603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 400 to user: Invalid volume: volume f835de01-aa74-4e80-a0a2-4f022b20354f is already attached to instances: 2b0c2e15-868c-49a1-8464-4ef339043aae {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:26:06.794603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d0eb5ae0-1b57-475b-8b2b-f8270f991a3f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105437 Jun 15 10:26:06.794603 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 673/1335] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:26:06 2022] POST /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:26:06.796562 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-900ee51d-26c6-4052-89c3-e8a6b0eb087f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:06.797073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-900ee51d-26c6-4052-89c3-e8a6b0eb087f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:06.803367 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-900ee51d-26c6-4052-89c3-e8a6b0eb087f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.803822 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-900ee51d-26c6-4052-89c3-e8a6b0eb087f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.804593 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-900ee51d-26c6-4052-89c3-e8a6b0eb087f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.805038 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-900ee51d-26c6-4052-89c3-e8a6b0eb087f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.831437 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-900ee51d-26c6-4052-89c3-e8a6b0eb087f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:26:06.908012 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-900ee51d-26c6-4052-89c3-e8a6b0eb087f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 204 len: 0 microversion: 2.1 time: 0.114970 Jun 15 10:26:06.908816 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 663/1336] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:26:06 2022] DELETE /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:26:06.917499 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d23b5de0-e482-4e3e-9fa1-e25002c4ce84 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:06.918387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d23b5de0-e482-4e3e-9fa1-e25002c4ce84 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:06.925350 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d23b5de0-e482-4e3e-9fa1-e25002c4ce84 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.925671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d23b5de0-e482-4e3e-9fa1-e25002c4ce84 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.926519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d23b5de0-e482-4e3e-9fa1-e25002c4ce84 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.926963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d23b5de0-e482-4e3e-9fa1-e25002c4ce84 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:07.063380 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d23b5de0-e482-4e3e-9fa1-e25002c4ce84 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:07.074106 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d23b5de0-e482-4e3e-9fa1-e25002c4ce84 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1681 microversion: 2.1 time: 0.160848 Jun 15 10:26:07.075207 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 674/1337] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:06 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:08.093283 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4f870070-6b41-4577-976c-e53f8b31b356 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:08.093988 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4f870070-6b41-4577-976c-e53f8b31b356 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:08.100742 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f870070-6b41-4577-976c-e53f8b31b356 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:08.101188 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f870070-6b41-4577-976c-e53f8b31b356 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:08.101950 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f870070-6b41-4577-976c-e53f8b31b356 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:08.102411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4f870070-6b41-4577-976c-e53f8b31b356 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:08.235253 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4f870070-6b41-4577-976c-e53f8b31b356 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:08.242580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4f870070-6b41-4577-976c-e53f8b31b356 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1681 microversion: 2.1 time: 0.154281 Jun 15 10:26:08.243141 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 664/1338] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:08 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:09.261067 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bcc28915-e251-4747-9dab-61eaa729156a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:09.261592 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bcc28915-e251-4747-9dab-61eaa729156a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:09.267673 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bcc28915-e251-4747-9dab-61eaa729156a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:09.268126 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bcc28915-e251-4747-9dab-61eaa729156a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:09.268880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bcc28915-e251-4747-9dab-61eaa729156a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:09.269351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bcc28915-e251-4747-9dab-61eaa729156a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:09.410688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bcc28915-e251-4747-9dab-61eaa729156a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:09.420031 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bcc28915-e251-4747-9dab-61eaa729156a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1681 microversion: 2.1 time: 0.163229 Jun 15 10:26:09.420791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 675/1339] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:09 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:10.437716 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6ada746f-2382-4668-8fe9-970842271756 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:10.438352 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6ada746f-2382-4668-8fe9-970842271756 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:10.445153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ada746f-2382-4668-8fe9-970842271756 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:10.445611 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ada746f-2382-4668-8fe9-970842271756 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:10.446418 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ada746f-2382-4668-8fe9-970842271756 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:10.446860 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ada746f-2382-4668-8fe9-970842271756 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:10.684054 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6ada746f-2382-4668-8fe9-970842271756 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:10.691642 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6ada746f-2382-4668-8fe9-970842271756 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1681 microversion: 2.1 time: 0.257826 Jun 15 10:26:10.692919 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 665/1340] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:10 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:11.473292 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-bfecdeaf-b7ae-4097-b5f1-3e2e85b9ec50 req-f0a17ca9-f15a-4132-9f62-6d8e32c46605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa75463-37d9-41ab-a4bc-6e3b07aa318f", "name": "network-vif-deleted", "tag": "73c7055c-4454-4744-8a62-7c4ff18bf4f8"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:11.495276 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-bfecdeaf-b7ae-4097-b5f1-3e2e85b9ec50 req-f0a17ca9-f15a-4132-9f62-6d8e32c46605 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:11.496215 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-bfecdeaf-b7ae-4097-b5f1-3e2e85b9ec50 req-f0a17ca9-f15a-4132-9f62-6d8e32c46605 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:11.515505 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-bfecdeaf-b7ae-4097-b5f1-3e2e85b9ec50 req-f0a17ca9-f15a-4132-9f62-6d8e32c46605 service nova] Creating event network-vif-deleted:73c7055c-4454-4744-8a62-7c4ff18bf4f8 for instance efa75463-37d9-41ab-a4bc-6e3b07aa318f on hv-cinder-83028 Jun 15 10:26:11.524520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-bfecdeaf-b7ae-4097-b5f1-3e2e85b9ec50 req-f0a17ca9-f15a-4132-9f62-6d8e32c46605 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060338 Jun 15 10:26:11.525721 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 676/1341] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:11.709346 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cf2342c2-271c-486c-9041-8c3306205b74 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:11.710105 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cf2342c2-271c-486c-9041-8c3306205b74 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:11.717861 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf2342c2-271c-486c-9041-8c3306205b74 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:11.718443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf2342c2-271c-486c-9041-8c3306205b74 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:11.719345 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf2342c2-271c-486c-9041-8c3306205b74 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:11.720337 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cf2342c2-271c-486c-9041-8c3306205b74 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:11.790429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-cf2342c2-271c-486c-9041-8c3306205b74 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:11.798719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cf2342c2-271c-486c-9041-8c3306205b74 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1613 microversion: 2.1 time: 0.093254 Jun 15 10:26:11.799706 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 666/1342] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:11 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:12.815944 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-12939c22-f01d-4663-8b7a-b503f800e096 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:12.816674 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-12939c22-f01d-4663-8b7a-b503f800e096 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:12.823701 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-12939c22-f01d-4663-8b7a-b503f800e096 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:12.824142 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-12939c22-f01d-4663-8b7a-b503f800e096 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:12.824896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-12939c22-f01d-4663-8b7a-b503f800e096 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:12.825329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-12939c22-f01d-4663-8b7a-b503f800e096 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:12.887963 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-12939c22-f01d-4663-8b7a-b503f800e096 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:12.896256 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-12939c22-f01d-4663-8b7a-b503f800e096 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1325 microversion: 2.1 time: 0.084439 Jun 15 10:26:12.896846 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 677/1343] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:12 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1325 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:13.913781 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-88cc748e-629f-41f9-a56e-c76298036cd2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:13.914432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-88cc748e-629f-41f9-a56e-c76298036cd2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:13.920932 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88cc748e-629f-41f9-a56e-c76298036cd2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:13.921376 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88cc748e-629f-41f9-a56e-c76298036cd2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:13.922124 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88cc748e-629f-41f9-a56e-c76298036cd2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:13.922583 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-88cc748e-629f-41f9-a56e-c76298036cd2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:13.988049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-88cc748e-629f-41f9-a56e-c76298036cd2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:13.996578 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-88cc748e-629f-41f9-a56e-c76298036cd2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 200 len: 1325 microversion: 2.1 time: 0.086581 Jun 15 10:26:13.997396 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 667/1344] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:13 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 1325 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:15.013114 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:15.013665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:15.020291 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:15.020739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.021522 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:15.021947 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.037600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f HTTP/1.1 Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:26:15.039270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:26:15.040941 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': 'efa75463-37d9-41ab-a4bc-6e3b07aa318f'} Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:26:15.042682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:26:15.044294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:15.045757 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:26:15.045757 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1b3626ec-626b-446e-a113-b3c388ab4f7f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 404 len: 111 microversion: 2.1 time: 0.031433 Jun 15 10:26:15.045757 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 678/1345] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:15 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:26:15.049932 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7092ea94-54ae-4321-aaf1-5c6b8ed79615 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '.version_select at 0x7fe25a826550>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:15.067497 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7092ea94-54ae-4321-aaf1-5c6b8ed79615 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1933403644" status: 202 len: 0 microversion: 2.1 time: 0.021286 Jun 15 10:26:15.068045 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 668/1346] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 10:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1933403644 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:26:15.719337 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ed9e0a62-d933-4072-876a-55337d36ef54 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:15.719834 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ed9e0a62-d933-4072-876a-55337d36ef54 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:15.726031 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed9e0a62-d933-4072-876a-55337d36ef54 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:15.726594 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed9e0a62-d933-4072-876a-55337d36ef54 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.727355 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed9e0a62-d933-4072-876a-55337d36ef54 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:15.727810 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ed9e0a62-d933-4072-876a-55337d36ef54 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.807522 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-ed9e0a62-d933-4072-876a-55337d36ef54 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lazy-loading 'services' on Instance uuid 2b0c2e15-868c-49a1-8464-4ef339043aae {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:26:15.879927 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ed9e0a62-d933-4072-876a-55337d36ef54 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments/f835de01-aa74-4e80-a0a2-4f022b20354f" status: 202 len: 0 microversion: 2.1 time: 0.164282 Jun 15 10:26:15.880508 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 679/1347] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:26:15 2022] DELETE /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments/f835de01-aa74-4e80-a0a2-4f022b20354f => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:26:15.889848 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2a220377-3101-408e-acbc-13d6b82fce4d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:15.890927 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-2a220377-3101-408e-acbc-13d6b82fce4d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:15.898170 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a220377-3101-408e-acbc-13d6b82fce4d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:15.898673 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a220377-3101-408e-acbc-13d6b82fce4d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.899686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a220377-3101-408e-acbc-13d6b82fce4d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:15.900616 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-2a220377-3101-408e-acbc-13d6b82fce4d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.934698 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2a220377-3101-408e-acbc-13d6b82fce4d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049730 Jun 15 10:26:15.935359 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 669/1348] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:26:15 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:26:16.948107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-b3483044-c7cf-4941-bafe-250cb951f5ea tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:16.949197 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-b3483044-c7cf-4941-bafe-250cb951f5ea tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:16.956637 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3483044-c7cf-4941-bafe-250cb951f5ea tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:16.957088 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3483044-c7cf-4941-bafe-250cb951f5ea tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:16.957855 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3483044-c7cf-4941-bafe-250cb951f5ea tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:16.958320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-b3483044-c7cf-4941-bafe-250cb951f5ea tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:16.988371 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-b3483044-c7cf-4941-bafe-250cb951f5ea tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045196 Jun 15 10:26:16.989264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 680/1349] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:26:16 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:18.000412 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b4211922-a300-4f22-8d89-617586575956 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:18.001341 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b4211922-a300-4f22-8d89-617586575956 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:18.009524 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b4211922-a300-4f22-8d89-617586575956 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.009976 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b4211922-a300-4f22-8d89-617586575956 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.010806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b4211922-a300-4f22-8d89-617586575956 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.011242 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b4211922-a300-4f22-8d89-617586575956 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.041824 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b4211922-a300-4f22-8d89-617586575956 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045255 Jun 15 10:26:18.042634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 670/1350] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:26:17 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:26:18.107632 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-665dfc00-7577-4ef7-82d1-1042cad5626c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:18.108181 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-665dfc00-7577-4ef7-82d1-1042cad5626c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:18.114394 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-665dfc00-7577-4ef7-82d1-1042cad5626c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.114853 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-665dfc00-7577-4ef7-82d1-1042cad5626c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.115620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-665dfc00-7577-4ef7-82d1-1042cad5626c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.116255 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-665dfc00-7577-4ef7-82d1-1042cad5626c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.141516 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-665dfc00-7577-4ef7-82d1-1042cad5626c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:26:18.212717 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-665dfc00-7577-4ef7-82d1-1042cad5626c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 204 len: 0 microversion: 2.1 time: 0.109117 Jun 15 10:26:18.213307 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 681/1351] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:26:18 2022] DELETE /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:26:18.222776 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-b44bf5a5-5fa5-4f96-877f-61dd655a6fa9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:18.223393 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-b44bf5a5-5fa5-4f96-877f-61dd655a6fa9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:18.229563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b44bf5a5-5fa5-4f96-877f-61dd655a6fa9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.230009 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b44bf5a5-5fa5-4f96-877f-61dd655a6fa9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.231415 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b44bf5a5-5fa5-4f96-877f-61dd655a6fa9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.231855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-b44bf5a5-5fa5-4f96-877f-61dd655a6fa9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.362712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-b44bf5a5-5fa5-4f96-877f-61dd655a6fa9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:18.370065 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-b44bf5a5-5fa5-4f96-877f-61dd655a6fa9 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1683 microversion: 2.1 time: 0.151123 Jun 15 10:26:18.370649 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 671/1352] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:18 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:19.388779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-15bd3a86-8079-4322-995d-e714399f6f95 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:19.389620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-15bd3a86-8079-4322-995d-e714399f6f95 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:19.396170 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-15bd3a86-8079-4322-995d-e714399f6f95 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:19.396605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-15bd3a86-8079-4322-995d-e714399f6f95 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:19.397472 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-15bd3a86-8079-4322-995d-e714399f6f95 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:19.397906 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-15bd3a86-8079-4322-995d-e714399f6f95 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:19.536725 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-15bd3a86-8079-4322-995d-e714399f6f95 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:19.544509 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-15bd3a86-8079-4322-995d-e714399f6f95 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1683 microversion: 2.1 time: 0.160960 Jun 15 10:26:19.545079 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 682/1353] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:19 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:20.563206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ef9ded9e-001b-466e-ad18-05cd27764b33 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:20.566308 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ef9ded9e-001b-466e-ad18-05cd27764b33 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:20.572719 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef9ded9e-001b-466e-ad18-05cd27764b33 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:20.573173 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef9ded9e-001b-466e-ad18-05cd27764b33 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:20.573945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef9ded9e-001b-466e-ad18-05cd27764b33 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:20.574478 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ef9ded9e-001b-466e-ad18-05cd27764b33 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:20.711547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ef9ded9e-001b-466e-ad18-05cd27764b33 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:20.719840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ef9ded9e-001b-466e-ad18-05cd27764b33 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1683 microversion: 2.1 time: 0.161963 Jun 15 10:26:20.720420 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 672/1354] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:20 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:21.737581 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48c8d5a8-b6bf-46d5-a5fd-8bfcd81b3563 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:21.738840 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-48c8d5a8-b6bf-46d5-a5fd-8bfcd81b3563 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:21.745990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48c8d5a8-b6bf-46d5-a5fd-8bfcd81b3563 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:21.746461 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48c8d5a8-b6bf-46d5-a5fd-8bfcd81b3563 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:21.747232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48c8d5a8-b6bf-46d5-a5fd-8bfcd81b3563 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:21.747671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48c8d5a8-b6bf-46d5-a5fd-8bfcd81b3563 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:21.941698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-48c8d5a8-b6bf-46d5-a5fd-8bfcd81b3563 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:21.950100 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-48c8d5a8-b6bf-46d5-a5fd-8bfcd81b3563 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1683 microversion: 2.1 time: 0.215741 Jun 15 10:26:21.950800 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 683/1355] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:21 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:22.967585 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6ef5bfa2-e404-40d4-b3a5-aa16cb1c2017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:22.968281 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6ef5bfa2-e404-40d4-b3a5-aa16cb1c2017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:22.975070 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ef5bfa2-e404-40d4-b3a5-aa16cb1c2017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.975588 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ef5bfa2-e404-40d4-b3a5-aa16cb1c2017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.976410 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ef5bfa2-e404-40d4-b3a5-aa16cb1c2017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.976911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-6ef5bfa2-e404-40d4-b3a5-aa16cb1c2017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:23.127461 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6ef5bfa2-e404-40d4-b3a5-aa16cb1c2017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:23.136174 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6ef5bfa2-e404-40d4-b3a5-aa16cb1c2017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1683 microversion: 2.1 time: 0.172790 Jun 15 10:26:23.136951 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 673/1356] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:22 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:24.154547 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-e3d969eb-ce31-46cf-ba3a-b39f456c4b5d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:24.155800 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-e3d969eb-ce31-46cf-ba3a-b39f456c4b5d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:24.162544 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3d969eb-ce31-46cf-ba3a-b39f456c4b5d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:24.163001 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3d969eb-ce31-46cf-ba3a-b39f456c4b5d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:24.163801 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3d969eb-ce31-46cf-ba3a-b39f456c4b5d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:24.164242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-e3d969eb-ce31-46cf-ba3a-b39f456c4b5d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:24.416076 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-e3d969eb-ce31-46cf-ba3a-b39f456c4b5d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:24.426070 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-e3d969eb-ce31-46cf-ba3a-b39f456c4b5d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1683 microversion: 2.1 time: 0.275378 Jun 15 10:26:24.438799 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 684/1357] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:24 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1683 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:25.435429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3be7481e-59a1-4bf9-9fb4-682f0617a965 req-17ad0cfd-27c6-4270-b849-c57d6d883140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0c2e15-868c-49a1-8464-4ef339043aae", "name": "network-vif-deleted", "tag": "4caeb751-19c4-4cb6-8dec-925f14000817"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:25.451343 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7f8dd52c-a4ad-4968-a2c4-0fe8928a2e79 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:25.452883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7f8dd52c-a4ad-4968-a2c4-0fe8928a2e79 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:25.463051 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8dd52c-a4ad-4968-a2c4-0fe8928a2e79 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.463681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8dd52c-a4ad-4968-a2c4-0fe8928a2e79 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:25.464474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8dd52c-a4ad-4968-a2c4-0fe8928a2e79 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.464918 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7f8dd52c-a4ad-4968-a2c4-0fe8928a2e79 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:25.477463 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3be7481e-59a1-4bf9-9fb4-682f0617a965 req-17ad0cfd-27c6-4270-b849-c57d6d883140 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.478339 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3be7481e-59a1-4bf9-9fb4-682f0617a965 req-17ad0cfd-27c6-4270-b849-c57d6d883140 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:25.499194 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3be7481e-59a1-4bf9-9fb4-682f0617a965 req-17ad0cfd-27c6-4270-b849-c57d6d883140 service nova] Creating event network-vif-deleted:4caeb751-19c4-4cb6-8dec-925f14000817 for instance 2b0c2e15-868c-49a1-8464-4ef339043aae on hv-cinder-83028 Jun 15 10:26:25.513506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3be7481e-59a1-4bf9-9fb4-682f0617a965 req-17ad0cfd-27c6-4270-b849-c57d6d883140 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082817 Jun 15 10:26:25.516403 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 674/1358] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:26:25.562999 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-7f8dd52c-a4ad-4968-a2c4-0fe8928a2e79 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:25.571856 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7f8dd52c-a4ad-4968-a2c4-0fe8928a2e79 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 200 len: 1616 microversion: 2.1 time: 0.125364 Jun 15 10:26:25.573005 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 685/1359] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:25 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 1616 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:26.593494 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:26.594243 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:26.600855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:26.601308 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:26.602296 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:26.602711 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:26.616893 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae HTTP/1.1 Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:26:26.618790 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:26:26.620565 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '2b0c2e15-868c-49a1-8464-4ef339043aae'} Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:26:26.621489 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:26:26.623460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:26.625615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:26:26.625615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7d9fab43-e3e5-4347-a4bf-61662646ea3a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 404 len: 111 microversion: 2.1 time: 0.032408 Jun 15 10:26:26.625615 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 675/1360] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:26 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:26:26.630213 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-aad7c965-0f24-45e8-a905-0340ea21fc56 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '.version_select at 0x7fe255dd0d30>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:26.647014 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-aad7c965-0f24-45e8-a905-0340ea21fc56 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129408435" status: 202 len: 0 microversion: 2.1 time: 0.020956 Jun 15 10:26:26.647589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 686/1361] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 10:26:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129408435 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:26:27.330291 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-03dceacf-02a0-4687-8f72-b4c4fd23d397 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: .version_select at 0x7fe255da7dc0>, body: {"keypair": {"name": "tempest-keypair-849053086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDRuCIK1CqrXFBwlQYRCgOnX1aKq85RlXhtuXkE4jnpaYLhaZVXcdl59KrIYxlUAgs9E06L6s74UkOiPtsHvHZe0QGmsqQMx2iqhtsZH41q46rGONowmItXSUIcrP8h1Q=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:27.346363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-03dceacf-02a0-4687-8f72-b4c4fd23d397 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for project 64d59f3545044033ab48f6253122fe64. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:26:27.350446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-03dceacf-02a0-4687-8f72-b4c4fd23d397 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for user 016f3ad72de247f991f1939a987a4ffb and project 64d59f3545044033ab48f6253122fe64. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:26:27.372502 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-03dceacf-02a0-4687-8f72-b4c4fd23d397 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046329 Jun 15 10:26:27.373096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 676/1362] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:26:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:28.809904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1852630961", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a0c7486-be27-43d5-98e8-c4309dfe22aa"}], "security_groups": [{"name": "tempest-securitygroup--1926955454"}], "key_name": "tempest-keypair-849053086", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:28.923638 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] validate_networks() for [('4a0c7486-be27-43d5-98e8-c4309dfe22aa', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:26:29.345703 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:26:29.346135 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:26:29.346651 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:26:29.347064 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:26:29.347480 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:26:29.356682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:29.357137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:29.357990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:29.359065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:29.376191 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for project 64d59f3545044033ab48f6253122fe64. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:26:29.380063 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for user 016f3ad72de247f991f1939a987a4ffb and project 64d59f3545044033ab48f6253122fe64. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:26:29.391690 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:26:29.393956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:26:29.442140 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1110680a-b18e-4732-a6a2-2d97772cd5ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.637267 Jun 15 10:26:29.442833 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 687/1363] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:26:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:26:29.454082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ba0a1fc0-e324-4e3a-b3cc-ad799a666b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:29.454713 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ba0a1fc0-e324-4e3a-b3cc-ad799a666b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:29.515058 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ba0a1fc0-e324-4e3a-b3cc-ad799a666b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:29.525646 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ba0a1fc0-e324-4e3a-b3cc-ad799a666b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1241 microversion: 2.1 time: 0.076811 Jun 15 10:26:29.536171 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 677/1364] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:29 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:30.544178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bc3ac5b5-1e8e-42fa-a008-5b9d96e45d86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:30.545074 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bc3ac5b5-1e8e-42fa-a008-5b9d96e45d86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:30.552164 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc3ac5b5-1e8e-42fa-a008-5b9d96e45d86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:30.552620 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc3ac5b5-1e8e-42fa-a008-5b9d96e45d86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:30.553409 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc3ac5b5-1e8e-42fa-a008-5b9d96e45d86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:30.553851 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bc3ac5b5-1e8e-42fa-a008-5b9d96e45d86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:30.626222 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bc3ac5b5-1e8e-42fa-a008-5b9d96e45d86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:30.638383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bc3ac5b5-1e8e-42fa-a008-5b9d96e45d86 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1293 microversion: 2.1 time: 0.098574 Jun 15 10:26:30.649535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 688/1365] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:30 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:31.656341 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-25962079-8614-46e9-bbc8-98c3fd910520 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:31.657057 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-25962079-8614-46e9-bbc8-98c3fd910520 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:31.666314 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-25962079-8614-46e9-bbc8-98c3fd910520 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:31.666865 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-25962079-8614-46e9-bbc8-98c3fd910520 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:31.683802 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-25962079-8614-46e9-bbc8-98c3fd910520 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:31.685434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-25962079-8614-46e9-bbc8-98c3fd910520 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:31.908460 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-25962079-8614-46e9-bbc8-98c3fd910520 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:31.916571 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-25962079-8614-46e9-bbc8-98c3fd910520 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1367 microversion: 2.1 time: 0.263957 Jun 15 10:26:31.917141 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 678/1366] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:31 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:32.249254 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-5d8969e6-e87e-42fb-a24b-c6b903d1e948 req-a87cb7c2-0733-499c-885c-0436c5c74e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113085dc-4952-4b35-8ae9-c81503d33500", "tag": "79bd7259-4436-41d4-8c72-1eb5074d1bdb"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:32.260504 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-5d8969e6-e87e-42fb-a24b-c6b903d1e948 req-a87cb7c2-0733-499c-885c-0436c5c74e1d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:32.261026 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-5d8969e6-e87e-42fb-a24b-c6b903d1e948 req-a87cb7c2-0733-499c-885c-0436c5c74e1d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:32.278643 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-5d8969e6-e87e-42fb-a24b-c6b903d1e948 req-a87cb7c2-0733-499c-885c-0436c5c74e1d service nova] Creating event network-changed:79bd7259-4436-41d4-8c72-1eb5074d1bdb for instance 113085dc-4952-4b35-8ae9-c81503d33500 on hv-cinder-83028 Jun 15 10:26:32.284668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-5d8969e6-e87e-42fb-a24b-c6b903d1e948 req-a87cb7c2-0733-499c-885c-0436c5c74e1d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039619 Jun 15 10:26:32.285711 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 689/1367] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:32.933795 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fae97cde-3dfe-4fec-a1ae-3f2271f3cb55 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:32.934443 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fae97cde-3dfe-4fec-a1ae-3f2271f3cb55 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:32.941594 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fae97cde-3dfe-4fec-a1ae-3f2271f3cb55 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:32.941966 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fae97cde-3dfe-4fec-a1ae-3f2271f3cb55 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:32.942782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fae97cde-3dfe-4fec-a1ae-3f2271f3cb55 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:32.943226 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fae97cde-3dfe-4fec-a1ae-3f2271f3cb55 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.083015 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fae97cde-3dfe-4fec-a1ae-3f2271f3cb55 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:33.090347 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fae97cde-3dfe-4fec-a1ae-3f2271f3cb55 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1367 microversion: 2.1 time: 0.160496 Jun 15 10:26:33.091145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 679/1368] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:32 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:34.108892 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-97c20d2b-614f-4d0c-a0b0-8568624f5f99 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:34.109713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-97c20d2b-614f-4d0c-a0b0-8568624f5f99 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:34.116073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97c20d2b-614f-4d0c-a0b0-8568624f5f99 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:34.116526 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97c20d2b-614f-4d0c-a0b0-8568624f5f99 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:34.117760 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97c20d2b-614f-4d0c-a0b0-8568624f5f99 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:34.117760 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-97c20d2b-614f-4d0c-a0b0-8568624f5f99 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:34.249794 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-97c20d2b-614f-4d0c-a0b0-8568624f5f99 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:34.253345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:34.258331 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-97c20d2b-614f-4d0c-a0b0-8568624f5f99 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1367 microversion: 2.1 time: 0.154777 Jun 15 10:26:34.258902 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 690/1369] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:34 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:35.274932 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-61328f76-1895-428d-b476-b5872735b5d0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:35.276251 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-61328f76-1895-428d-b476-b5872735b5d0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:35.283712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-61328f76-1895-428d-b476-b5872735b5d0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.284162 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-61328f76-1895-428d-b476-b5872735b5d0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.285164 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-61328f76-1895-428d-b476-b5872735b5d0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.285604 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-61328f76-1895-428d-b476-b5872735b5d0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.513029 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-61328f76-1895-428d-b476-b5872735b5d0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:35.524459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-61328f76-1895-428d-b476-b5872735b5d0 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1367 microversion: 2.1 time: 0.253132 Jun 15 10:26:35.525442 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 680/1370] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:35 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:35.958204 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-409f0873-7bad-4ec3-b2b5-f0ab44fce173 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:35.958724 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-409f0873-7bad-4ec3-b2b5-f0ab44fce173 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:35.960480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-fb379d8e-1058-413d-9ec8-715073efc0ad req-4469fd77-0723-4fa8-9f55-07a1048a14d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b46d3605-3910-41a8-9a91-80edb73244d5", "tag": "05535f67-6da4-45e4-88ef-7dcce81df253"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:35.966679 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-409f0873-7bad-4ec3-b2b5-f0ab44fce173 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.967270 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-409f0873-7bad-4ec3-b2b5-f0ab44fce173 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.968791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-409f0873-7bad-4ec3-b2b5-f0ab44fce173 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.969265 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-409f0873-7bad-4ec3-b2b5-f0ab44fce173 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.971472 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-fb379d8e-1058-413d-9ec8-715073efc0ad req-4469fd77-0723-4fa8-9f55-07a1048a14d6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.971918 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-fb379d8e-1058-413d-9ec8-715073efc0ad req-4469fd77-0723-4fa8-9f55-07a1048a14d6 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.983391 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-fb379d8e-1058-413d-9ec8-715073efc0ad req-4469fd77-0723-4fa8-9f55-07a1048a14d6 service nova] Creating event network-changed:05535f67-6da4-45e4-88ef-7dcce81df253 for instance b46d3605-3910-41a8-9a91-80edb73244d5 on hv-cinder-83028 Jun 15 10:26:35.989091 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-fb379d8e-1058-413d-9ec8-715073efc0ad req-4469fd77-0723-4fa8-9f55-07a1048a14d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031783 Jun 15 10:26:35.989253 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 681/1371] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:35.996406 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-409f0873-7bad-4ec3-b2b5-f0ab44fce173 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:26:36.075901 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-409f0873-7bad-4ec3-b2b5-f0ab44fce173 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 204 len: 0 microversion: 2.1 time: 0.122095 Jun 15 10:26:36.081386 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 691/1372] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:26:35 2022] DELETE /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:26:36.086815 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4a63fbfb-9ffa-4d23-8b79-5dcaef1743cc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:36.087525 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-4a63fbfb-9ffa-4d23-8b79-5dcaef1743cc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:36.094635 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4a63fbfb-9ffa-4d23-8b79-5dcaef1743cc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.095085 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4a63fbfb-9ffa-4d23-8b79-5dcaef1743cc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.095855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4a63fbfb-9ffa-4d23-8b79-5dcaef1743cc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.096292 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-4a63fbfb-9ffa-4d23-8b79-5dcaef1743cc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.100789 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:36.233138 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-4a63fbfb-9ffa-4d23-8b79-5dcaef1743cc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:36.240757 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4a63fbfb-9ffa-4d23-8b79-5dcaef1743cc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1575 microversion: 2.1 time: 0.158774 Jun 15 10:26:36.241336 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 682/1373] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:36 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:36.541446 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f6c17965-8805-4400-80d0-d7f300c991c4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:36.542616 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f6c17965-8805-4400-80d0-d7f300c991c4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:36.549045 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f6c17965-8805-4400-80d0-d7f300c991c4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.549507 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f6c17965-8805-4400-80d0-d7f300c991c4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.550736 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f6c17965-8805-4400-80d0-d7f300c991c4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.550861 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f6c17965-8805-4400-80d0-d7f300c991c4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.693721 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-f6c17965-8805-4400-80d0-d7f300c991c4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:36.702301 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f6c17965-8805-4400-80d0-d7f300c991c4 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1367 microversion: 2.1 time: 0.164284 Jun 15 10:26:36.712226 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 692/1374] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:36 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:37.257477 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-300d1dbf-687c-45f4-a454-c5b0103d406d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:37.258089 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-300d1dbf-687c-45f4-a454-c5b0103d406d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:37.260397 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:37.265707 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-300d1dbf-687c-45f4-a454-c5b0103d406d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.266153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-300d1dbf-687c-45f4-a454-c5b0103d406d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.266938 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-300d1dbf-687c-45f4-a454-c5b0103d406d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.267375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-300d1dbf-687c-45f4-a454-c5b0103d406d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.473217 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-300d1dbf-687c-45f4-a454-c5b0103d406d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:37.480893 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-300d1dbf-687c-45f4-a454-c5b0103d406d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1575 microversion: 2.1 time: 0.227323 Jun 15 10:26:37.481466 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 683/1375] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:37 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:37.719912 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-40bd116b-3886-4893-86e0-16fdb0d85113 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:37.720537 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-40bd116b-3886-4893-86e0-16fdb0d85113 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:37.723232 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:37.728921 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-40bd116b-3886-4893-86e0-16fdb0d85113 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.729376 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-40bd116b-3886-4893-86e0-16fdb0d85113 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.730140 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-40bd116b-3886-4893-86e0-16fdb0d85113 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.730602 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-40bd116b-3886-4893-86e0-16fdb0d85113 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.881364 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-40bd116b-3886-4893-86e0-16fdb0d85113 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:37.888672 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-40bd116b-3886-4893-86e0-16fdb0d85113 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1367 microversion: 2.1 time: 0.173665 Jun 15 10:26:37.889294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 693/1376] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:37 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:38.501008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ee6fe85b-aa8f-4b79-8c6e-d8205138424f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:38.501529 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ee6fe85b-aa8f-4b79-8c6e-d8205138424f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:38.508206 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee6fe85b-aa8f-4b79-8c6e-d8205138424f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.508653 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee6fe85b-aa8f-4b79-8c6e-d8205138424f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.509434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee6fe85b-aa8f-4b79-8c6e-d8205138424f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.509873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ee6fe85b-aa8f-4b79-8c6e-d8205138424f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.727337 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ee6fe85b-aa8f-4b79-8c6e-d8205138424f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:38.736181 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ee6fe85b-aa8f-4b79-8c6e-d8205138424f tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1575 microversion: 2.1 time: 0.239623 Jun 15 10:26:38.745549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 684/1377] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:38 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:38.828432 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-fcad3ae2-59d9-4692-b328-cc2aaf960ab0 req-b7e77968-9529-4b3d-b24a-5a5f1f1ca11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113085dc-4952-4b35-8ae9-c81503d33500", "name": "network-vif-plugged", "status": "completed", "tag": "79bd7259-4436-41d4-8c72-1eb5074d1bdb"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:38.839244 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-fcad3ae2-59d9-4692-b328-cc2aaf960ab0 req-b7e77968-9529-4b3d-b24a-5a5f1f1ca11d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.841356 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-fcad3ae2-59d9-4692-b328-cc2aaf960ab0 req-b7e77968-9529-4b3d-b24a-5a5f1f1ca11d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.854654 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-fcad3ae2-59d9-4692-b328-cc2aaf960ab0 req-b7e77968-9529-4b3d-b24a-5a5f1f1ca11d service nova] Creating event network-vif-plugged:79bd7259-4436-41d4-8c72-1eb5074d1bdb for instance 113085dc-4952-4b35-8ae9-c81503d33500 on hv-cinder-83028 Jun 15 10:26:38.860416 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-fcad3ae2-59d9-4692-b328-cc2aaf960ab0 req-b7e77968-9529-4b3d-b24a-5a5f1f1ca11d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041065 Jun 15 10:26:38.861636 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 694/1378] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:38.905989 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-21fd347b-328f-4616-a099-07b8aec0b840 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:38.907278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-21fd347b-328f-4616-a099-07b8aec0b840 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:38.915328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21fd347b-328f-4616-a099-07b8aec0b840 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.915881 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21fd347b-328f-4616-a099-07b8aec0b840 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.916749 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21fd347b-328f-4616-a099-07b8aec0b840 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.917360 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-21fd347b-328f-4616-a099-07b8aec0b840 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.085372 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-7de3b7c7-e412-41b8-9b65-86590010a234 req-166ebc18-74cc-402c-9de6-6f3b24e05b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b46d3605-3910-41a8-9a91-80edb73244d5", "name": "network-vif-deleted", "tag": "05535f67-6da4-45e4-88ef-7dcce81df253"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:39.096284 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-7de3b7c7-e412-41b8-9b65-86590010a234 req-166ebc18-74cc-402c-9de6-6f3b24e05b67 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.096892 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-7de3b7c7-e412-41b8-9b65-86590010a234 req-166ebc18-74cc-402c-9de6-6f3b24e05b67 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.108527 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-21fd347b-328f-4616-a099-07b8aec0b840 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:39.109896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-7de3b7c7-e412-41b8-9b65-86590010a234 req-166ebc18-74cc-402c-9de6-6f3b24e05b67 service nova] Creating event network-vif-deleted:05535f67-6da4-45e4-88ef-7dcce81df253 for instance b46d3605-3910-41a8-9a91-80edb73244d5 on hv-cinder-83028 Jun 15 10:26:39.116620 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-21fd347b-328f-4616-a099-07b8aec0b840 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1367 microversion: 2.1 time: 0.214969 Jun 15 10:26:39.117207 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 685/1379] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:38 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:39.129045 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-7de3b7c7-e412-41b8-9b65-86590010a234 req-166ebc18-74cc-402c-9de6-6f3b24e05b67 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047518 Jun 15 10:26:39.129658 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 695/1380] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:26:39.754972 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:39.756161 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:39.758736 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=6 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:39.764384 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.764944 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.765831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.766459 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.799340 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.799792 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.800240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lazy-loading 'fault' on Instance uuid b46d3605-3910-41a8-9a91-80edb73244d5 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:26:39.846712 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:39.854506 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-0197387d-c7b5-4234-afdc-397f00b6ff31 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1230 microversion: 2.1 time: 0.104532 Jun 15 10:26:39.855069 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 686/1381] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:39 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:40.131430 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:40.132198 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:40.136722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8198616c-3f9c-40ec-b132-7cf3ff8c424b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:40.137430 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8198616c-3f9c-40ec-b132-7cf3ff8c424b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:40.145143 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8198616c-3f9c-40ec-b132-7cf3ff8c424b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.145600 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8198616c-3f9c-40ec-b132-7cf3ff8c424b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.146402 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8198616c-3f9c-40ec-b132-7cf3ff8c424b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.146850 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8198616c-3f9c-40ec-b132-7cf3ff8c424b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.280312 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8198616c-3f9c-40ec-b132-7cf3ff8c424b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:40.287688 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8198616c-3f9c-40ec-b132-7cf3ff8c424b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1367 microversion: 2.1 time: 0.157224 Jun 15 10:26:40.288263 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 696/1382] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:40 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:40.872386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:40.873008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:40.880211 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.880663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.881446 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.881858 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.911793 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.912234 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.912679 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.objects.instance [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lazy-loading 'fault' on Instance uuid b46d3605-3910-41a8-9a91-80edb73244d5 {{(pid=117721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:26:41.215853 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:41.225607 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-090e8c1f-0589-4a51-9856-8668faef3d07 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 200 len: 1184 microversion: 2.1 time: 0.357300 Jun 15 10:26:41.226328 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 687/1383] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:40 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 1184 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:41.304728 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6fc50403-469b-444a-8366-90a80422bbe1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:41.305351 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6fc50403-469b-444a-8366-90a80422bbe1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:41.312702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6fc50403-469b-444a-8366-90a80422bbe1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.313157 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6fc50403-469b-444a-8366-90a80422bbe1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.313967 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6fc50403-469b-444a-8366-90a80422bbe1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.314448 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6fc50403-469b-444a-8366-90a80422bbe1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.440815 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6fc50403-469b-444a-8366-90a80422bbe1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:41.448094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6fc50403-469b-444a-8366-90a80422bbe1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1557 microversion: 2.1 time: 0.147223 Jun 15 10:26:41.448660 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 697/1384] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:41 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:41.464530 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-94af98ed-563f-4bbe-9bda-ccd4deefb41b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:41.465032 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-94af98ed-563f-4bbe-9bda-ccd4deefb41b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:41.471934 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94af98ed-563f-4bbe-9bda-ccd4deefb41b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.472386 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94af98ed-563f-4bbe-9bda-ccd4deefb41b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.473175 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94af98ed-563f-4bbe-9bda-ccd4deefb41b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.473610 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-94af98ed-563f-4bbe-9bda-ccd4deefb41b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.552945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-94af98ed-563f-4bbe-9bda-ccd4deefb41b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092230 Jun 15 10:26:41.553547 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 688/1385] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 10:26:41 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:42.243144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:42.243858 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: b46d3605-3910-41a8-9a91-80edb73244d5] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:42.250170 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:42.250673 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:42.251462 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:42.251901 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:42.265520 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] HTTP exception thrown: Instance b46d3605-3910-41a8-9a91-80edb73244d5 could not be found. Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Request method failure captured: Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 HTTP/1.1 Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbGiuwcgnz3wAPZXdYJtOedD4ae_NvXThHBveFffcWUmhQj8aGA9KkY8u47psBq0MODP2szIKlYPN6IvAcVoxpXybqrQHejffaprf1b3zSGI5F-sxSszwkvrTyD9AdjQI9iWg-d05BoZgEZqQ159KdqRA4xpFLAq3nF2TWlAw3IGM8k Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:26:42.267178 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c6cf56db2b454c688b9305ef587f407e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 9ee3b5927ffa4ef5b7f617073e083a80 Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance b46d3605-3910-41a8-9a91-80edb73244d5 could not be found. Jun 15 10:26:42.268808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': 'b46d3605-3910-41a8-9a91-80edb73244d5'} Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b46d3605-3910-41a8-9a91-80edb73244d5 could not be found. Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:26:42.270221 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b46d3605-3910-41a8-9a91-80edb73244d5 could not be found. Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b46d3605-3910-41a8-9a91-80edb73244d5 could not be found. Jun 15 10:26:42.271568 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:42.272810 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Returning 404 to user: Instance b46d3605-3910-41a8-9a91-80edb73244d5 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:26:42.272810 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-234897dd-ec81-40ec-9415-18525043696b tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5" status: 404 len: 111 microversion: 2.1 time: 0.029289 Jun 15 10:26:42.272810 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 698/1386] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:42 2022] GET /compute/v2.1/servers/b46d3605-3910-41a8-9a91-80edb73244d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:26:42.651025 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-e79e821e-e27f-44b3-8361-50b6fba3be91 req-dac0f746-d756-49cd-8b04-23086ea8f123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113085dc-4952-4b35-8ae9-c81503d33500", "tag": "79bd7259-4436-41d4-8c72-1eb5074d1bdb"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:42.659994 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-e79e821e-e27f-44b3-8361-50b6fba3be91 req-dac0f746-d756-49cd-8b04-23086ea8f123 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:42.660445 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-e79e821e-e27f-44b3-8361-50b6fba3be91 req-dac0f746-d756-49cd-8b04-23086ea8f123 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:42.671692 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-e79e821e-e27f-44b3-8361-50b6fba3be91 req-dac0f746-d756-49cd-8b04-23086ea8f123 service nova] Creating event network-changed:79bd7259-4436-41d4-8c72-1eb5074d1bdb for instance 113085dc-4952-4b35-8ae9-c81503d33500 on hv-cinder-83028 Jun 15 10:26:42.676580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-e79e821e-e27f-44b3-8361-50b6fba3be91 req-dac0f746-d756-49cd-8b04-23086ea8f123 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030001 Jun 15 10:26:42.677387 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 689/1387] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:45.326338 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-47599513-91e5-417c-8a8e-88c0accde0d2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:45.327610 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-47599513-91e5-417c-8a8e-88c0accde0d2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:45.331135 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-a0c61b26-ac98-437e-b81b-8487338bc843 req-6de30984-fa60-401d-a4c4-e2dc2a3b750e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3108892e-7e39-4745-9fe8-def8a153e577", "tag": "2351e726-d5be-48b8-b869-58a22c8cf327"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:45.334852 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47599513-91e5-417c-8a8e-88c0accde0d2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.335322 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47599513-91e5-417c-8a8e-88c0accde0d2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.336454 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47599513-91e5-417c-8a8e-88c0accde0d2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.336547 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-47599513-91e5-417c-8a8e-88c0accde0d2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.341782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a0c61b26-ac98-437e-b81b-8487338bc843 req-6de30984-fa60-401d-a4c4-e2dc2a3b750e service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.343018 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-a0c61b26-ac98-437e-b81b-8487338bc843 req-6de30984-fa60-401d-a4c4-e2dc2a3b750e service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.355288 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-a0c61b26-ac98-437e-b81b-8487338bc843 req-6de30984-fa60-401d-a4c4-e2dc2a3b750e service nova] Creating event network-changed:2351e726-d5be-48b8-b869-58a22c8cf327 for instance 3108892e-7e39-4745-9fe8-def8a153e577 on hv-cinder-83028 Jun 15 10:26:45.361371 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-a0c61b26-ac98-437e-b81b-8487338bc843 req-6de30984-fa60-401d-a4c4-e2dc2a3b750e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035696 Jun 15 10:26:45.361974 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 690/1388] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:45.385269 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-47599513-91e5-417c-8a8e-88c0accde0d2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Going to try to terminate instance {{(pid=117720) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:26:45.481525 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-47599513-91e5-417c-8a8e-88c0accde0d2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 204 len: 0 microversion: 2.1 time: 0.159241 Jun 15 10:26:45.485741 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 699/1389] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:26:45 2022] DELETE /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:26:45.491882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-50f26809-346e-4b9f-98b4-813a9a7359ab tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:45.492662 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-50f26809-346e-4b9f-98b4-813a9a7359ab tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:45.500535 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-50f26809-346e-4b9f-98b4-813a9a7359ab tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.501096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-50f26809-346e-4b9f-98b4-813a9a7359ab tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.501932 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-50f26809-346e-4b9f-98b4-813a9a7359ab tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.502473 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-50f26809-346e-4b9f-98b4-813a9a7359ab tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.664356 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-50f26809-346e-4b9f-98b4-813a9a7359ab tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:45.672911 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-50f26809-346e-4b9f-98b4-813a9a7359ab tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1576 microversion: 2.1 time: 0.185530 Jun 15 10:26:45.673499 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 691/1390] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:45 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:46.691231 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-bf63f60b-5da5-4c28-bd33-18412123c3fc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:46.691960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-bf63f60b-5da5-4c28-bd33-18412123c3fc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:46.699333 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf63f60b-5da5-4c28-bd33-18412123c3fc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.699781 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf63f60b-5da5-4c28-bd33-18412123c3fc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.700627 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf63f60b-5da5-4c28-bd33-18412123c3fc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.701069 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-bf63f60b-5da5-4c28-bd33-18412123c3fc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.916387 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-bf63f60b-5da5-4c28-bd33-18412123c3fc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:46.929401 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-bf63f60b-5da5-4c28-bd33-18412123c3fc tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1576 microversion: 2.1 time: 0.242411 Jun 15 10:26:46.930498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 700/1391] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:46 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:47.948167 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fbd3f272-3a60-49d7-b970-b849da485386 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:47.948850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fbd3f272-3a60-49d7-b970-b849da485386 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:47.956165 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fbd3f272-3a60-49d7-b970-b849da485386 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.956687 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fbd3f272-3a60-49d7-b970-b849da485386 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.957517 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fbd3f272-3a60-49d7-b970-b849da485386 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.958040 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fbd3f272-3a60-49d7-b970-b849da485386 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.986827 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-d3f58d27-588a-4d84-b392-61368622fe27 req-3a4a9909-9958-4619-a269-52e5da86112a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3108892e-7e39-4745-9fe8-def8a153e577", "name": "network-vif-deleted", "tag": "2351e726-d5be-48b8-b869-58a22c8cf327"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:47.996862 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-d3f58d27-588a-4d84-b392-61368622fe27 req-3a4a9909-9958-4619-a269-52e5da86112a service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.997837 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-d3f58d27-588a-4d84-b392-61368622fe27 req-3a4a9909-9958-4619-a269-52e5da86112a service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:48.009714 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-d3f58d27-588a-4d84-b392-61368622fe27 req-3a4a9909-9958-4619-a269-52e5da86112a service nova] Creating event network-vif-deleted:2351e726-d5be-48b8-b869-58a22c8cf327 for instance 3108892e-7e39-4745-9fe8-def8a153e577 on hv-cinder-83028 Jun 15 10:26:48.015885 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-d3f58d27-588a-4d84-b392-61368622fe27 req-3a4a9909-9958-4619-a269-52e5da86112a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 Jun 15 10:26:48.016719 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 701/1392] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:26:48.035613 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-fbd3f272-3a60-49d7-b970-b849da485386 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:48.044532 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fbd3f272-3a60-49d7-b970-b849da485386 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1390 microversion: 2.1 time: 0.100421 Jun 15 10:26:48.045110 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 692/1393] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:47 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1390 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:49.062149 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:49.063249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:49.071344 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.071687 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.072546 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.073086 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.107437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.107922 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.108467 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lazy-loading 'fault' on Instance uuid 3108892e-7e39-4745-9fe8-def8a153e577 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:26:49.157913 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee3b5927ffa4ef5b7f617073e083a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6cf56db2b454c688b9305ef587f407e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:49.164903 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d98d7750-0b87-49cf-9aa4-c1f7cd124b57 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 200 len: 1184 microversion: 2.1 time: 0.107548 Jun 15 10:26:49.165485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 702/1394] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:49 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 1184 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:49.304581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:26:49.305081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Wed Jun 15 10:26:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:26:50.182240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:50.182875 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 3108892e-7e39-4745-9fe8-def8a153e577] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:50.189202 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.189652 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.190461 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.190901 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.204747 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] HTTP exception thrown: Instance 3108892e-7e39-4745-9fe8-def8a153e577 could not be found. Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Request method failure captured: Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 HTTP/1.1 Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbGiuwcgnz3wAPZXdYJtOedD4ae_NvXThHBveFffcWUmhQj8aGA9KkY8u47psBq0MODP2szIKlYPN6IvAcVoxpXybqrQHejffaprf1b3zSGI5F-sxSszwkvrTyD9AdjQI9iWg-d05BoZgEZqQ159KdqRA4xpFLAq3nF2TWlAw3IGM8k Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:26:50.207557 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c6cf56db2b454c688b9305ef587f407e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 9ee3b5927ffa4ef5b7f617073e083a80 Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 3108892e-7e39-4745-9fe8-def8a153e577 could not be found. Jun 15 10:26:50.210847 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '3108892e-7e39-4745-9fe8-def8a153e577'} Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3108892e-7e39-4745-9fe8-def8a153e577 could not be found. Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:26:50.211900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3108892e-7e39-4745-9fe8-def8a153e577 could not be found. Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3108892e-7e39-4745-9fe8-def8a153e577 could not be found. Jun 15 10:26:50.214145 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.216086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Returning 404 to user: Instance 3108892e-7e39-4745-9fe8-def8a153e577 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:26:50.216086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-05836003-9bea-4220-bc31-111333ae9d3d tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577" status: 404 len: 111 microversion: 2.1 time: 0.030685 Jun 15 10:26:50.216086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 693/1395] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:50 2022] GET /compute/v2.1/servers/3108892e-7e39-4745-9fe8-def8a153e577 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:26:50.661702 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:50.662218 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:50.668874 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.669330 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.670097 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.670710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.683532 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] HTTP exception thrown: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Request method failure captured: Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 HTTP/1.1 Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbGiuwcgnz3wAPZXdYJtOedD4ae_NvXThHBveFffcWUmhQj8aGA9KkY8u47psBq0MODP2szIKlYPN6IvAcVoxpXybqrQHejffaprf1b3zSGI5F-sxSszwkvrTyD9AdjQI9iWg-d05BoZgEZqQ159KdqRA4xpFLAq3nF2TWlAw3IGM8k Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:26:50.685214 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c6cf56db2b454c688b9305ef587f407e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 9ee3b5927ffa4ef5b7f617073e083a80 Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.687329 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '7f2b6202-44f6-40f9-849b-5803d6bc4804'} Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:26:50.690073 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.691639 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.693160 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Returning 404 to user: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:26:50.693160 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ab5db51b-b534-477f-88d0-e5dac922d6a2 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 404 len: 111 microversion: 2.1 time: 0.029363 Jun 15 10:26:50.693160 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 703/1396] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:26:50 2022] DELETE /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:26:50.695637 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:50.696250 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] [instance: 7f2b6202-44f6-40f9-849b-5803d6bc4804] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:50.703037 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.703465 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.704221 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.704658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.717631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] HTTP exception thrown: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Request method failure captured: Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 HTTP/1.1 Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbGiuwcgnz3wAPZXdYJtOedD4ae_NvXThHBveFffcWUmhQj8aGA9KkY8u47psBq0MODP2szIKlYPN6IvAcVoxpXybqrQHejffaprf1b3zSGI5F-sxSszwkvrTyD9AdjQI9iWg-d05BoZgEZqQ159KdqRA4xpFLAq3nF2TWlAw3IGM8k Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:26:50.719183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c6cf56db2b454c688b9305ef587f407e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c6cf56db2b454c688b9305ef587f407e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: c6cf56db2b454c688b9305ef587f407e Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-TestVolumeBootPattern-680872277 Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 9ee3b5927ffa4ef5b7f617073e083a80 Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-TestVolumeBootPattern-680872277-project Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.720797 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '7f2b6202-44f6-40f9-849b-5803d6bc4804'} Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:26:50.721710 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. Jun 15 10:26:50.723225 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:26:50.724873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Returning 404 to user: Instance 7f2b6202-44f6-40f9-849b-5803d6bc4804 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:26:50.724873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-97c8c726-998d-452f-84a4-418271510c03 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804" status: 404 len: 111 microversion: 2.1 time: 0.028728 Jun 15 10:26:50.724873 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 694/1397] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:50 2022] GET /compute/v2.1/servers/7f2b6202-44f6-40f9-849b-5803d6bc4804 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:26:55.162806 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-d05a7b97-1e58-451e-be48-e580a362bb20 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] Calling method '.version_select at 0x7fe255df1af0>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:55.180776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-d05a7b97-1e58-451e-be48-e580a362bb20 tempest-TestVolumeBootPattern-680872277 tempest-TestVolumeBootPattern-680872277-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-552614952" status: 202 len: 0 microversion: 2.1 time: 0.021716 Jun 15 10:26:55.181465 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 704/1398] 10.222.0.57 () {58 vars in 1259 bytes} [Wed Jun 15 10:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-552614952 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:28:12.516933 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=27 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:12.517701 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=62 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:12.781397 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ec240ed4-9641-4a98-a868-64a1e06f319d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:12.781892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ec240ed4-9641-4a98-a868-64a1e06f319d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:12.788876 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ec240ed4-9641-4a98-a868-64a1e06f319d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:12.789319 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ec240ed4-9641-4a98-a868-64a1e06f319d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:12.790081 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ec240ed4-9641-4a98-a868-64a1e06f319d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:12.790543 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ec240ed4-9641-4a98-a868-64a1e06f319d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:12.813439 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ec240ed4-9641-4a98-a868-64a1e06f319d tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/ips" status: 200 len: 149 microversion: 2.1 time: 0.298219 Jun 15 10:28:12.813981 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 695/1399] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:28:12 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/ips => generated 149 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:14.135759 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:14.136498 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:14.141077 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-1ffa5eb9-0756-4776-96ba-8c4913ab35e5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a7d04d-b980-4da3-a624-86a7fb12882e"}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:14.142146 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-1ffa5eb9-0756-4776-96ba-8c4913ab35e5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:14.151529 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ffa5eb9-0756-4776-96ba-8c4913ab35e5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:14.151981 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ffa5eb9-0756-4776-96ba-8c4913ab35e5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:14.152740 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ffa5eb9-0756-4776-96ba-8c4913ab35e5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:14.153181 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-1ffa5eb9-0756-4776-96ba-8c4913ab35e5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:14.415426 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-1ffa5eb9-0756-4776-96ba-8c4913ab35e5 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281365 Jun 15 10:28:14.416015 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 705/1400] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:28:14 2022] POST /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:21.904928 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a7d04d-b980-4da3-a624-86a7fb12882e"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:21.906060 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:21.912063 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:21.912688 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:21.913663 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:21.914109 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:21.993894 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Invalid volume: volume 37a7d04d-b980-4da3-a624-86a7fb12882e is already attached to instances: 113085dc-4952-4b35-8ae9-c81503d33500 Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: POST /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments HTTP/1.1 Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 74 Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:28:21.995566 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {"volumeAttachment": {"volumeId": "37a7d04d-b980-4da3-a624-86a7fb12882e"}} Jun 15 10:28:21.997330 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Invalid volume: volume 37a7d04d-b980-4da3-a624-86a7fb12882e is already attached to instances: 113085dc-4952-4b35-8ae9-c81503d33500 Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'server_id': '113085dc-4952-4b35-8ae9-c81503d33500', 'body': {'volumeAttachment': {'volumeId': '37a7d04d-b980-4da3-a624-86a7fb12882e'}}} Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 37a7d04d-b980-4da3-a624-86a7fb12882e is already attached to instances: 113085dc-4952-4b35-8ae9-c81503d33500 Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:21.998432 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 37a7d04d-b980-4da3-a624-86a7fb12882e is already attached to instances: 113085dc-4952-4b35-8ae9-c81503d33500 Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:22.000101 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:28:22.001826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:28:22.001826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:28:22.001826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:28:22.001826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 37a7d04d-b980-4da3-a624-86a7fb12882e is already attached to instances: 113085dc-4952-4b35-8ae9-c81503d33500 Jun 15 10:28:22.001826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:22.001826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 400 to user: Invalid volume: volume 37a7d04d-b980-4da3-a624-86a7fb12882e is already attached to instances: 113085dc-4952-4b35-8ae9-c81503d33500 {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:28:22.001826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-e5cb4c88-bb2e-42c1-a98c-c28e87ed1b85 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096274 Jun 15 10:28:22.001826 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 696/1401] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:28:21 2022] POST /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 10:28:22.057775 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0201a0da-0d65-4f57-9ff6-899e722c251b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:22.058298 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0201a0da-0d65-4f57-9ff6-899e722c251b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:22.064593 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201a0da-0d65-4f57-9ff6-899e722c251b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:22.065037 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201a0da-0d65-4f57-9ff6-899e722c251b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:22.065801 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201a0da-0d65-4f57-9ff6-899e722c251b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:22.066237 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0201a0da-0d65-4f57-9ff6-899e722c251b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:22.148557 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-0201a0da-0d65-4f57-9ff6-899e722c251b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lazy-loading 'services' on Instance uuid 113085dc-4952-4b35-8ae9-c81503d33500 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:28:22.223935 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0201a0da-0d65-4f57-9ff6-899e722c251b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments/37a7d04d-b980-4da3-a624-86a7fb12882e" status: 202 len: 0 microversion: 2.1 time: 0.170795 Jun 15 10:28:22.224589 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 706/1402] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:28:22 2022] DELETE /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments/37a7d04d-b980-4da3-a624-86a7fb12882e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:28:22.233362 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-3016de72-497e-4834-8849-13d4149f15cb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:22.234411 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-3016de72-497e-4834-8849-13d4149f15cb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:22.242011 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3016de72-497e-4834-8849-13d4149f15cb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:22.242580 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3016de72-497e-4834-8849-13d4149f15cb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:22.243549 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3016de72-497e-4834-8849-13d4149f15cb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:22.244014 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-3016de72-497e-4834-8849-13d4149f15cb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:22.273763 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-3016de72-497e-4834-8849-13d4149f15cb tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Jun 15 10:28:22.274338 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 697/1403] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:28:22 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:23.289337 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-f76177fd-ec56-423d-9b41-6440b61138c2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:23.290345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-f76177fd-ec56-423d-9b41-6440b61138c2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:23.296569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f76177fd-ec56-423d-9b41-6440b61138c2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:23.297030 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f76177fd-ec56-423d-9b41-6440b61138c2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:23.297808 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f76177fd-ec56-423d-9b41-6440b61138c2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:23.298250 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-f76177fd-ec56-423d-9b41-6440b61138c2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:23.326075 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-f76177fd-ec56-423d-9b41-6440b61138c2 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044119 Jun 15 10:28:23.326656 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 707/1404] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:28:23 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 10:28:23.385618 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-15f9c690-c978-4340-842f-ac847f0c3e76 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:23.386116 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-15f9c690-c978-4340-842f-ac847f0c3e76 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:23.392636 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-15f9c690-c978-4340-842f-ac847f0c3e76 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:23.393086 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-15f9c690-c978-4340-842f-ac847f0c3e76 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:23.393834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-15f9c690-c978-4340-842f-ac847f0c3e76 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:23.394281 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-15f9c690-c978-4340-842f-ac847f0c3e76 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:23.418817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-15f9c690-c978-4340-842f-ac847f0c3e76 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:28:23.493327 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-15f9c690-c978-4340-842f-ac847f0c3e76 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 204 len: 0 microversion: 2.1 time: 0.111869 Jun 15 10:28:23.494097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 698/1405] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:28:23 2022] DELETE /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:28:23.502862 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-dbf109b5-9a40-45db-b0f4-371a9271527e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:23.504264 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-dbf109b5-9a40-45db-b0f4-371a9271527e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:23.509422 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbf109b5-9a40-45db-b0f4-371a9271527e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:23.509872 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbf109b5-9a40-45db-b0f4-371a9271527e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:23.510657 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbf109b5-9a40-45db-b0f4-371a9271527e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:23.511084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-dbf109b5-9a40-45db-b0f4-371a9271527e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:23.639434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-dbf109b5-9a40-45db-b0f4-371a9271527e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:23.646956 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-dbf109b5-9a40-45db-b0f4-371a9271527e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1681 microversion: 2.1 time: 0.148056 Jun 15 10:28:23.647548 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 708/1406] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:23 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:28:24.664581 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f1e4b34e-526a-42a2-9f6d-c7bd3f7cbf82 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:24.665278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f1e4b34e-526a-42a2-9f6d-c7bd3f7cbf82 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:24.671638 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1e4b34e-526a-42a2-9f6d-c7bd3f7cbf82 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:24.672073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1e4b34e-526a-42a2-9f6d-c7bd3f7cbf82 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:24.672850 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1e4b34e-526a-42a2-9f6d-c7bd3f7cbf82 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:24.673280 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f1e4b34e-526a-42a2-9f6d-c7bd3f7cbf82 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:24.806899 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f1e4b34e-526a-42a2-9f6d-c7bd3f7cbf82 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:24.814340 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f1e4b34e-526a-42a2-9f6d-c7bd3f7cbf82 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1681 microversion: 2.1 time: 0.153920 Jun 15 10:28:24.814914 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 699/1407] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:24 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:25.832193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-a80fb39d-81b4-4590-afab-5f5f9742233e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:25.832761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-a80fb39d-81b4-4590-afab-5f5f9742233e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:25.839449 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a80fb39d-81b4-4590-afab-5f5f9742233e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:25.839903 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a80fb39d-81b4-4590-afab-5f5f9742233e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:25.840681 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a80fb39d-81b4-4590-afab-5f5f9742233e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:25.841120 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-a80fb39d-81b4-4590-afab-5f5f9742233e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:26.059607 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-a80fb39d-81b4-4590-afab-5f5f9742233e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:26.067137 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-a80fb39d-81b4-4590-afab-5f5f9742233e tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1681 microversion: 2.1 time: 0.238945 Jun 15 10:28:26.067711 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 709/1408] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:25 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:26.695564 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-3f9db716-4973-4745-9f42-02a069e4d3cd req-9c46d3da-8543-4e2d-a4da-4e0b9d229829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113085dc-4952-4b35-8ae9-c81503d33500", "name": "network-vif-deleted", "tag": "79bd7259-4436-41d4-8c72-1eb5074d1bdb"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:26.706191 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3f9db716-4973-4745-9f42-02a069e4d3cd req-9c46d3da-8543-4e2d-a4da-4e0b9d229829 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:26.706659 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-3f9db716-4973-4745-9f42-02a069e4d3cd req-9c46d3da-8543-4e2d-a4da-4e0b9d229829 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:26.721732 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-3f9db716-4973-4745-9f42-02a069e4d3cd req-9c46d3da-8543-4e2d-a4da-4e0b9d229829 service nova] Creating event network-vif-deleted:79bd7259-4436-41d4-8c72-1eb5074d1bdb for instance 113085dc-4952-4b35-8ae9-c81503d33500 on hv-cinder-83028 Jun 15 10:28:26.728375 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-3f9db716-4973-4745-9f42-02a069e4d3cd req-9c46d3da-8543-4e2d-a4da-4e0b9d229829 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036761 Jun 15 10:28:26.729053 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 700/1409] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:27.085162 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:27.085776 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:27.092515 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:27.092960 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:27.093817 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:27.094253 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:27.144074 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:27.145135 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:27.145661 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lazy-loading 'fault' on Instance uuid 113085dc-4952-4b35-8ae9-c81503d33500 {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:28:27.193379 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:27.201305 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-cb13ecf8-ae6b-4a4f-8970-82122c714871 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 200 len: 1331 microversion: 2.1 time: 0.120204 Jun 15 10:28:27.202235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 710/1410] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:27 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:28.220100 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:28.220840 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:28.227442 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:28.227892 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:28.228658 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:28.229096 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:28.242106 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 HTTP/1.1 Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:28:28.243728 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:28:28.245389 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '113085dc-4952-4b35-8ae9-c81503d33500'} Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:28:28.246394 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:28:28.247737 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:28:28.249052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:28:28.249052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-da952675-ee11-4119-8e7e-c3a3c43159c1 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 404 len: 111 microversion: 2.1 time: 0.029655 Jun 15 10:28:28.249052 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 701/1411] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:28 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:28:28.253771 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-53d27a7d-30f9-41fc-b0c4-a10710d3a4ab tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '.version_select at 0x7fe25a85af70>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:28.272383 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-53d27a7d-30f9-41fc-b0c4-a10710d3a4ab tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-849053086" status: 202 len: 0 microversion: 2.1 time: 0.021750 Jun 15 10:28:28.272950 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 711/1412] 10.222.0.57 () {58 vars in 1217 bytes} [Wed Jun 15 10:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-849053086 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:28:28.894634 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-4a6cd9c0-1a43-48ca-8a0f-ee34d32a2b35 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: .version_select at 0x7fe25a795160>, body: {"keypair": {"name": "tempest-keypair-1086766283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuaoB109kETlPBsiKNPw7J3VfFY3LrWCP6G0Rtf1XSeTVdu+M0qzSjAMleHN77X9Y2QvVkQEsNh05FsV4j/O+xYuJOXgtTi1eeZid5lP8TI3RgokRW96Is7SPIz01KQJw=="}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:28.908659 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-4a6cd9c0-1a43-48ca-8a0f-ee34d32a2b35 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for project 64d59f3545044033ab48f6253122fe64. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:28:28.913353 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.quota [None req-4a6cd9c0-1a43-48ca-8a0f-ee34d32a2b35 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for user 016f3ad72de247f991f1939a987a4ffb and project 64d59f3545044033ab48f6253122fe64. Resources: {'key_pairs'} {{(pid=117721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:28:28.935588 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-4a6cd9c0-1a43-48ca-8a0f-ee34d32a2b35 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044883 Jun 15 10:28:28.936388 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 702/1413] 10.222.0.57 () {60 vars in 1158 bytes} [Wed Jun 15 10:28:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:30.152398 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-953143923", "imageRef": "63602f23-e999-4bd7-a413-bc2e75f22bcd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a0c7486-be27-43d5-98e8-c4309dfe22aa"}], "security_groups": [{"name": "tempest-securitygroup--1280833856"}], "key_name": "tempest-keypair-1086766283", "user_data": "}} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:30.376482 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.network.neutron [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] validate_networks() for [('4a0c7486-be27-43d5-98e8-c4309dfe22aa', None, None, None, None, None)] {{(pid=117720) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:28:30.744640 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Flavor limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:28:30.745187 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Image limits 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:28:30.745671 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Flavor pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:28:30.746084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Image pref 0:0:0 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:28:30.746529 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.virt.hardware [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:28:30.755243 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:30.755693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:30.757108 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:30.757545 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:30.773756 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for project 64d59f3545044033ab48f6253122fe64. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:28:30.777722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.quota [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Getting quotas for user 016f3ad72de247f991f1939a987a4ffb and project 64d59f3545044033ab48f6253122fe64. Resources: {'instances', 'cores', 'ram'} {{(pid=117720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:28:30.788551 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Going to run 1 instances... {{(pid=117720) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:28:30.790788 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63602f23-e999-4bd7-a413-bc2e75f22bcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:28:30.836094 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-0184d5de-5ed4-48d2-95a5-60f97a81e017 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.688362 Jun 15 10:28:30.836684 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 712/1414] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Jun 15 10:28:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:28:30.847516 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-6bceca6c-1141-4481-b2b1-3c203049be30 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:30.848240 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-6bceca6c-1141-4481-b2b1-3c203049be30 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:31.019398 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-6bceca6c-1141-4481-b2b1-3c203049be30 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:31.028429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-6bceca6c-1141-4481-b2b1-3c203049be30 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1241 microversion: 2.1 time: 0.185187 Jun 15 10:28:31.029182 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 703/1415] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:30 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1241 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:32.047444 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-5a8cd601-f389-4e90-957f-c4aa21b8e67f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:32.048065 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-5a8cd601-f389-4e90-957f-c4aa21b8e67f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:32.055470 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5a8cd601-f389-4e90-957f-c4aa21b8e67f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:32.055928 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5a8cd601-f389-4e90-957f-c4aa21b8e67f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:32.056700 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5a8cd601-f389-4e90-957f-c4aa21b8e67f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:32.057144 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-5a8cd601-f389-4e90-957f-c4aa21b8e67f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:32.133810 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-5a8cd601-f389-4e90-957f-c4aa21b8e67f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:32.141431 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-5a8cd601-f389-4e90-957f-c4aa21b8e67f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1299 microversion: 2.1 time: 0.098235 Jun 15 10:28:32.142012 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 713/1416] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:32 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:33.158866 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-52d391fe-e58c-4f55-8fb8-0d1f4efbed44 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:33.159480 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-52d391fe-e58c-4f55-8fb8-0d1f4efbed44 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:33.168380 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-52d391fe-e58c-4f55-8fb8-0d1f4efbed44 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:33.168831 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-52d391fe-e58c-4f55-8fb8-0d1f4efbed44 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:33.169614 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-52d391fe-e58c-4f55-8fb8-0d1f4efbed44 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:33.170048 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-52d391fe-e58c-4f55-8fb8-0d1f4efbed44 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:33.359943 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-35bcd7f4-da90-45ba-a2df-d531748d09ff req-e59e2b85-34f7-4bf2-a55f-4375f4911c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e7dbb5-8ac1-4cf1-b748-9c967945834e", "tag": "607c1668-f823-4dd0-a294-595e3cec7216"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:33.373929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-35bcd7f4-da90-45ba-a2df-d531748d09ff req-e59e2b85-34f7-4bf2-a55f-4375f4911c7d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:33.374424 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-35bcd7f4-da90-45ba-a2df-d531748d09ff req-e59e2b85-34f7-4bf2-a55f-4375f4911c7d service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:33.399150 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-52d391fe-e58c-4f55-8fb8-0d1f4efbed44 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:33.400569 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-35bcd7f4-da90-45ba-a2df-d531748d09ff req-e59e2b85-34f7-4bf2-a55f-4375f4911c7d service nova] Creating event network-changed:607c1668-f823-4dd0-a294-595e3cec7216 for instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e on hv-cinder-83028 Jun 15 10:28:33.406833 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-35bcd7f4-da90-45ba-a2df-d531748d09ff req-e59e2b85-34f7-4bf2-a55f-4375f4911c7d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057583 Jun 15 10:28:33.407217 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-52d391fe-e58c-4f55-8fb8-0d1f4efbed44 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1367 microversion: 2.1 time: 0.252080 Jun 15 10:28:33.407742 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 714/1417] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:28:33.408249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 704/1418] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:33 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:34.424739 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8c36688e-4304-4b97-8f0c-8c67fb86ce2a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:34.425437 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8c36688e-4304-4b97-8f0c-8c67fb86ce2a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:34.431692 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c36688e-4304-4b97-8f0c-8c67fb86ce2a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:34.432133 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c36688e-4304-4b97-8f0c-8c67fb86ce2a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:34.432883 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c36688e-4304-4b97-8f0c-8c67fb86ce2a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:34.433315 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c36688e-4304-4b97-8f0c-8c67fb86ce2a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:34.562761 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-8c36688e-4304-4b97-8f0c-8c67fb86ce2a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:34.570165 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8c36688e-4304-4b97-8f0c-8c67fb86ce2a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1367 microversion: 2.1 time: 0.150071 Jun 15 10:28:34.570760 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 715/1419] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:34 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:35.587270 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-9c8534e6-146d-4b64-af2b-8cf4e21f3a21 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:35.587885 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-9c8534e6-146d-4b64-af2b-8cf4e21f3a21 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:35.595049 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c8534e6-146d-4b64-af2b-8cf4e21f3a21 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:35.595497 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c8534e6-146d-4b64-af2b-8cf4e21f3a21 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:35.596255 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c8534e6-146d-4b64-af2b-8cf4e21f3a21 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:35.596694 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-9c8534e6-146d-4b64-af2b-8cf4e21f3a21 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:35.730147 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-9c8534e6-146d-4b64-af2b-8cf4e21f3a21 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:35.737588 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-9c8534e6-146d-4b64-af2b-8cf4e21f3a21 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1367 microversion: 2.1 time: 0.154671 Jun 15 10:28:35.738151 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 705/1420] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:35 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:28:36.757162 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-226f627a-1d1c-45d3-8f72-968c343ae46c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:36.758225 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-226f627a-1d1c-45d3-8f72-968c343ae46c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:36.764782 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-226f627a-1d1c-45d3-8f72-968c343ae46c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:36.765235 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-226f627a-1d1c-45d3-8f72-968c343ae46c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:36.766006 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-226f627a-1d1c-45d3-8f72-968c343ae46c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:36.766474 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-226f627a-1d1c-45d3-8f72-968c343ae46c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:36.900854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-226f627a-1d1c-45d3-8f72-968c343ae46c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:36.908267 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-226f627a-1d1c-45d3-8f72-968c343ae46c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1367 microversion: 2.1 time: 0.157191 Jun 15 10:28:36.908832 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 716/1421] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:36 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:37.924943 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-ac8c3532-cd16-4a02-9210-29a09626329f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:37.925558 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-ac8c3532-cd16-4a02-9210-29a09626329f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:37.932475 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ac8c3532-cd16-4a02-9210-29a09626329f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:37.932954 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ac8c3532-cd16-4a02-9210-29a09626329f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:37.933716 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ac8c3532-cd16-4a02-9210-29a09626329f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:37.934153 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-ac8c3532-cd16-4a02-9210-29a09626329f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:38.060853 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-ac8c3532-cd16-4a02-9210-29a09626329f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:38.068143 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-ac8c3532-cd16-4a02-9210-29a09626329f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1367 microversion: 2.1 time: 0.147067 Jun 15 10:28:38.069282 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 706/1422] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:37 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:38.740706 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [req-7c9fe64b-f216-445e-9e54-822f046f917e req-7d68273e-0b5d-470f-a9d7-d5307172abba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e7dbb5-8ac1-4cf1-b748-9c967945834e", "name": "network-vif-plugged", "status": "completed", "tag": "607c1668-f823-4dd0-a294-595e3cec7216"}]} {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:38.749764 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-7c9fe64b-f216-445e-9e54-822f046f917e req-7d68273e-0b5d-470f-a9d7-d5307172abba service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:38.750211 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [req-7c9fe64b-f216-445e-9e54-822f046f917e req-7d68273e-0b5d-470f-a9d7-d5307172abba service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:38.762471 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.compute.server_external_events [req-7c9fe64b-f216-445e-9e54-822f046f917e req-7d68273e-0b5d-470f-a9d7-d5307172abba service nova] Creating event network-vif-plugged:607c1668-f823-4dd0-a294-595e3cec7216 for instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e on hv-cinder-83028 Jun 15 10:28:38.767285 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [req-7c9fe64b-f216-445e-9e54-822f046f917e req-7d68273e-0b5d-470f-a9d7-d5307172abba service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031779 Jun 15 10:28:38.767884 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 717/1423] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:39.085611 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-58d8fc34-992c-44d0-be39-3e03405c7130 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:39.086211 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-58d8fc34-992c-44d0-be39-3e03405c7130 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:39.092629 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58d8fc34-992c-44d0-be39-3e03405c7130 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:39.093073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58d8fc34-992c-44d0-be39-3e03405c7130 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:39.093816 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58d8fc34-992c-44d0-be39-3e03405c7130 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:39.094249 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-58d8fc34-992c-44d0-be39-3e03405c7130 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:39.222122 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-58d8fc34-992c-44d0-be39-3e03405c7130 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:39.230363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-58d8fc34-992c-44d0-be39-3e03405c7130 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1367 microversion: 2.1 time: 0.148639 Jun 15 10:28:39.230928 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 707/1424] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:39 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:40.248445 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-41ba01c2-0ab9-46f0-9a68-355ccb27197f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:40.249145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-41ba01c2-0ab9-46f0-9a68-355ccb27197f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:40.255289 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-41ba01c2-0ab9-46f0-9a68-355ccb27197f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:40.255754 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-41ba01c2-0ab9-46f0-9a68-355ccb27197f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:40.256665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-41ba01c2-0ab9-46f0-9a68-355ccb27197f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:40.257101 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-41ba01c2-0ab9-46f0-9a68-355ccb27197f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:40.391668 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-41ba01c2-0ab9-46f0-9a68-355ccb27197f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:40.399689 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-41ba01c2-0ab9-46f0-9a68-355ccb27197f tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1367 microversion: 2.1 time: 0.155992 Jun 15 10:28:40.400252 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 718/1425] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:40 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:41.416738 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-f8d2129e-467c-4099-8c4a-8e2bda87d655 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:41.417358 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-f8d2129e-467c-4099-8c4a-8e2bda87d655 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:41.419809 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell0:SELECT=6 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:41.425369 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f8d2129e-467c-4099-8c4a-8e2bda87d655 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:41.425821 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f8d2129e-467c-4099-8c4a-8e2bda87d655 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:41.426627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f8d2129e-467c-4099-8c4a-8e2bda87d655 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:41.427073 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-f8d2129e-467c-4099-8c4a-8e2bda87d655 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:41.561769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-f8d2129e-467c-4099-8c4a-8e2bda87d655 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:41.569984 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-f8d2129e-467c-4099-8c4a-8e2bda87d655 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1557 microversion: 2.1 time: 0.157080 Jun 15 10:28:41.570586 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 708/1426] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:41 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:41.587134 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-8c3c4be8-3e40-4ea4-9204-70431cf8f9ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:41.587621 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-8c3c4be8-3e40-4ea4-9204-70431cf8f9ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:41.590436 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:41.591095 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell0:SELECT=6 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:41.597829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c3c4be8-3e40-4ea4-9204-70431cf8f9ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:41.598294 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c3c4be8-3e40-4ea4-9204-70431cf8f9ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:41.599084 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c3c4be8-3e40-4ea4-9204-70431cf8f9ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:41.599578 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-8c3c4be8-3e40-4ea4-9204-70431cf8f9ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:41.674605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-8c3c4be8-3e40-4ea4-9204-70431cf8f9ed tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092291 Jun 15 10:28:41.675193 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 719/1427] 10.222.0.57 () {58 vars in 1274 bytes} [Wed Jun 15 10:28:41 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:42.581686 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-11e03c3b-697b-4fd8-852b-ed2e44855a54 req-ab7a2dbb-2bcd-471f-a13c-0eb80178d2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e7dbb5-8ac1-4cf1-b748-9c967945834e", "tag": "607c1668-f823-4dd0-a294-595e3cec7216"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:42.585799 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:42.591434 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-11e03c3b-697b-4fd8-852b-ed2e44855a54 req-ab7a2dbb-2bcd-471f-a13c-0eb80178d2fa service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:42.591875 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-11e03c3b-697b-4fd8-852b-ed2e44855a54 req-ab7a2dbb-2bcd-471f-a13c-0eb80178d2fa service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:42.595802 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG dbcounter [-] [117721] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:42.605278 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-11e03c3b-697b-4fd8-852b-ed2e44855a54 req-ab7a2dbb-2bcd-471f-a13c-0eb80178d2fa service nova] Creating event network-changed:607c1668-f823-4dd0-a294-595e3cec7216 for instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e on hv-cinder-83028 Jun 15 10:28:42.610537 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-11e03c3b-697b-4fd8-852b-ed2e44855a54 req-ab7a2dbb-2bcd-471f-a13c-0eb80178d2fa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032767 Jun 15 10:28:42.611383 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 709/1428] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:57.811854 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:57.812882 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG dbcounter [-] [117720] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:57.817223 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6a8041e5-f938-4a88-9c46-e27857fa498b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:57.817713 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6a8041e5-f938-4a88-9c46-e27857fa498b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:57.825908 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6a8041e5-f938-4a88-9c46-e27857fa498b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:57.826385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6a8041e5-f938-4a88-9c46-e27857fa498b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:57.827171 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6a8041e5-f938-4a88-9c46-e27857fa498b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:57.827605 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6a8041e5-f938-4a88-9c46-e27857fa498b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:57.852236 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6a8041e5-f938-4a88-9c46-e27857fa498b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/ips" status: 200 len: 150 microversion: 2.1 time: 0.042144 Jun 15 10:29:57.852791 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 720/1429] 10.222.0.57 () {58 vars in 1247 bytes} [Wed Jun 15 10:29:57 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:59.178771 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cd0902ed-1ca9-4136-9979-24eab6bf3e37 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1a0e7f7-fa29-4738-ad60-f79817998609"}} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:29:59.179908 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cd0902ed-1ca9-4136-9979-24eab6bf3e37 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:59.187233 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd0902ed-1ca9-4136-9979-24eab6bf3e37 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:59.187676 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd0902ed-1ca9-4136-9979-24eab6bf3e37 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:59.188429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd0902ed-1ca9-4136-9979-24eab6bf3e37 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:59.188859 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cd0902ed-1ca9-4136-9979-24eab6bf3e37 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:59.443553 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cd0902ed-1ca9-4136-9979-24eab6bf3e37 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "POST /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271600 Jun 15 10:29:59.445760 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 710/1430] 10.222.0.57 () {60 vars in 1322 bytes} [Wed Jun 15 10:29:59 2022] POST /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:07.036173 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-7790411a-61c0-4380-b1da-b8a54267098c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:07.036664 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-7790411a-61c0-4380-b1da-b8a54267098c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:07.042896 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7790411a-61c0-4380-b1da-b8a54267098c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.043345 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7790411a-61c0-4380-b1da-b8a54267098c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.044107 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7790411a-61c0-4380-b1da-b8a54267098c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.044546 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-7790411a-61c0-4380-b1da-b8a54267098c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.123682 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.objects.instance [None req-7790411a-61c0-4380-b1da-b8a54267098c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lazy-loading 'services' on Instance uuid 27e7dbb5-8ac1-4cf1-b748-9c967945834e {{(pid=117720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:30:07.207864 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-7790411a-61c0-4380-b1da-b8a54267098c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-volume_attachments/c1a0e7f7-fa29-4738-ad60-f79817998609" status: 202 len: 0 microversion: 2.1 time: 0.175436 Jun 15 10:30:07.208440 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 721/1431] 10.222.0.57 () {58 vars in 1415 bytes} [Wed Jun 15 10:30:07 2022] DELETE /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-volume_attachments/c1a0e7f7-fa29-4738-ad60-f79817998609 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:30:07.217309 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-af1abd6c-893e-45f7-bc70-8a87b2e85f6b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:07.218493 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-af1abd6c-893e-45f7-bc70-8a87b2e85f6b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:07.226395 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af1abd6c-893e-45f7-bc70-8a87b2e85f6b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.226846 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af1abd6c-893e-45f7-bc70-8a87b2e85f6b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.228220 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af1abd6c-893e-45f7-bc70-8a87b2e85f6b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.228667 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-af1abd6c-893e-45f7-bc70-8a87b2e85f6b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.261139 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-af1abd6c-893e-45f7-bc70-8a87b2e85f6b tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048007 Jun 15 10:30:07.261813 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 711/1432] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:07 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:08.273472 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-ae604f06-e808-4e25-915f-9d1d65545148 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:08.274535 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-ae604f06-e808-4e25-915f-9d1d65545148 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:08.281320 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae604f06-e808-4e25-915f-9d1d65545148 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:08.281779 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae604f06-e808-4e25-915f-9d1d65545148 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:08.282577 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae604f06-e808-4e25-915f-9d1d65545148 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:08.283024 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-ae604f06-e808-4e25-915f-9d1d65545148 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:08.311274 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-ae604f06-e808-4e25-915f-9d1d65545148 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042162 Jun 15 10:30:08.311825 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 722/1433] 10.222.0.57 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:08 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:30:08.372849 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-7c4b1eeb-b763-4c4d-b29c-289e48577670 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:08.373343 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7c4b1eeb-b763-4c4d-b29c-289e48577670 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:08.379614 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7c4b1eeb-b763-4c4d-b29c-289e48577670 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:08.380051 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7c4b1eeb-b763-4c4d-b29c-289e48577670 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:08.380799 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7c4b1eeb-b763-4c4d-b29c-289e48577670 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:08.381430 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-7c4b1eeb-b763-4c4d-b29c-289e48577670 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:08.405418 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-7c4b1eeb-b763-4c4d-b29c-289e48577670 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Going to try to terminate instance {{(pid=117721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:30:08.480304 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-7c4b1eeb-b763-4c4d-b29c-289e48577670 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 204 len: 0 microversion: 2.1 time: 0.111081 Jun 15 10:30:08.480954 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 712/1434] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:30:08 2022] DELETE /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:30:08.489093 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-672765cd-5cac-45c1-835c-d0ad17b65913 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:08.489707 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-672765cd-5cac-45c1-835c-d0ad17b65913 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:08.496249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-672765cd-5cac-45c1-835c-d0ad17b65913 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:08.496698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-672765cd-5cac-45c1-835c-d0ad17b65913 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:08.497455 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-672765cd-5cac-45c1-835c-d0ad17b65913 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:08.497891 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-672765cd-5cac-45c1-835c-d0ad17b65913 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:08.637255 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-672765cd-5cac-45c1-835c-d0ad17b65913 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:08.644939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-672765cd-5cac-45c1-835c-d0ad17b65913 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1682 microversion: 2.1 time: 0.159645 Jun 15 10:30:08.645519 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 723/1435] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:08 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:09.312785 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:30:09.312960 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Wed Jun 15 10:30:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:30:09.664399 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-593a6ce1-5b56-455f-8ffc-c83b0d975228 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:09.665082 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-593a6ce1-5b56-455f-8ffc-c83b0d975228 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:09.671852 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-593a6ce1-5b56-455f-8ffc-c83b0d975228 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:09.672295 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-593a6ce1-5b56-455f-8ffc-c83b0d975228 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:09.673046 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-593a6ce1-5b56-455f-8ffc-c83b0d975228 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:09.673483 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-593a6ce1-5b56-455f-8ffc-c83b0d975228 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:09.801363 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.policy [None req-593a6ce1-5b56-455f-8ffc-c83b0d975228 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:09.809524 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-593a6ce1-5b56-455f-8ffc-c83b0d975228 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1682 microversion: 2.1 time: 0.149344 Jun 15 10:30:09.810097 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 713/1436] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:09 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:10.826929 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-6cb3a5e2-136a-4960-8526-f6506ff29992 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:10.827483 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-6cb3a5e2-136a-4960-8526-f6506ff29992 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:10.835476 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cb3a5e2-136a-4960-8526-f6506ff29992 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:10.835476 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cb3a5e2-136a-4960-8526-f6506ff29992 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:10.835767 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cb3a5e2-136a-4960-8526-f6506ff29992 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:10.836249 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-6cb3a5e2-136a-4960-8526-f6506ff29992 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:11.059109 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.policy [None req-6cb3a5e2-136a-4960-8526-f6506ff29992 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016f3ad72de247f991f1939a987a4ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d59f3545044033ab48f6253122fe64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117720) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:11.072874 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-6cb3a5e2-136a-4960-8526-f6506ff29992 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 200 len: 1682 microversion: 2.1 time: 0.247375 Jun 15 10:30:11.083134 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 724/1437] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:10 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:11.519709 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [req-ecd192d8-58ac-4702-9cc3-87f19290bf5c req-6758a7fd-efef-4198-8ca0-4380502aac99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e7dbb5-8ac1-4cf1-b748-9c967945834e", "name": "network-vif-deleted", "tag": "607c1668-f823-4dd0-a294-595e3cec7216"}]} {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:30:11.533033 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ecd192d8-58ac-4702-9cc3-87f19290bf5c req-6758a7fd-efef-4198-8ca0-4380502aac99 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:11.533482 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [req-ecd192d8-58ac-4702-9cc3-87f19290bf5c req-6758a7fd-efef-4198-8ca0-4380502aac99 service nova] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:11.546160 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.compute.server_external_events [req-ecd192d8-58ac-4702-9cc3-87f19290bf5c req-6758a7fd-efef-4198-8ca0-4380502aac99 service nova] Creating event network-vif-deleted:607c1668-f823-4dd0-a294-595e3cec7216 for instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e on hv-cinder-83028 Jun 15 10:30:11.551631 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [req-ecd192d8-58ac-4702-9cc3-87f19290bf5c req-6758a7fd-efef-4198-8ca0-4380502aac99 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121000 Jun 15 10:30:11.556855 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 714/1438] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Jun 15 10:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:12.091665 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:12.092384 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:12.099594 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:12.100166 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:12.101031 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:12.101546 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:12.116303 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e HTTP/1.1 Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:30:12.118513 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:12.120339 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '27e7dbb5-8ac1-4cf1-b748-9c967945834e'} Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:12.121485 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:12.123242 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:12.124772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:12.124772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-48125a8e-31c7-4314-9f99-13dbe845053a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 404 len: 111 microversion: 2.1 time: 0.032173 Jun 15 10:30:12.124772 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 725/1439] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:12 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:30:12.129974 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-2b1b7705-4e25-4abf-80e0-337a26903111 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '.version_select at 0x7fe25a826a60>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:12.150670 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-2b1b7705-4e25-4abf-80e0-337a26903111 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086766283" status: 202 len: 0 microversion: 2.1 time: 0.024719 Jun 15 10:30:12.151263 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 715/1440] 10.222.0.57 () {58 vars in 1220 bytes} [Wed Jun 15 10:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086766283 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:30:13.908766 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:13.909255 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:13.916636 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.917086 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.917848 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.918313 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.932496 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e HTTP/1.1 Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:30:13.934019 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.935798 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '27e7dbb5-8ac1-4cf1-b748-9c967945834e'} Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:13.936792 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.938412 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.940029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:13.940029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-528b078c-4c21-441c-a5f0-db0fc01ab10c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 404 len: 111 microversion: 2.1 time: 0.030438 Jun 15 10:30:13.940029 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 726/1441] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:30:13 2022] DELETE /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:30:13.944718 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:13.945461 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 27e7dbb5-8ac1-4cf1-b748-9c967945834e] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:13.951627 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.952076 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.952834 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.953271 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.969485 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e HTTP/1.1 Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:30:13.971104 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.972769 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '27e7dbb5-8ac1-4cf1-b748-9c967945834e'} Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:13.973768 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. Jun 15 10:30:13.975929 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:13.977639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 27e7dbb5-8ac1-4cf1-b748-9c967945834e could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:13.977639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-483cef07-0c0a-45be-b00e-cc3dfe752d98 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e" status: 404 len: 111 microversion: 2.1 time: 0.032649 Jun 15 10:30:13.977639 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 716/1442] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:13 2022] GET /compute/v2.1/servers/27e7dbb5-8ac1-4cf1-b748-9c967945834e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:30:15.114784 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:15.115955 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:15.122760 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.123217 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.123990 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.124434 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.137880 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 HTTP/1.1 Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:30:15.139442 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.141104 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '113085dc-4952-4b35-8ae9-c81503d33500'} Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:15.142125 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.143710 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.145410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:15.145410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-426c5774-845b-4c56-98cf-b4da556a8b22 tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 404 len: 111 microversion: 2.1 time: 0.029980 Jun 15 10:30:15.145410 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 727/1443] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:30:15 2022] DELETE /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:30:15.149183 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:15.149817 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 113085dc-4952-4b35-8ae9-c81503d33500] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:15.156238 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.156682 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.157428 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.157858 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.171294 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 HTTP/1.1 Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:30:15.172782 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.174563 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '113085dc-4952-4b35-8ae9-c81503d33500'} Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:15.175648 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. Jun 15 10:30:15.177276 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.178724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 113085dc-4952-4b35-8ae9-c81503d33500 could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:15.178724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-a6607856-9b9d-4674-8384-bec1e4df9c5c tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500" status: 404 len: 111 microversion: 2.1 time: 0.028902 Jun 15 10:30:15.178724 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 717/1444] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:15 2022] GET /compute/v2.1/servers/113085dc-4952-4b35-8ae9-c81503d33500 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:30:15.183312 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:15.183842 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:15.189693 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.190145 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.190946 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.191385 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.204687 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f HTTP/1.1 Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:30:15.206129 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.207857 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': 'efa75463-37d9-41ab-a4bc-6e3b07aa318f'} Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:15.208985 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.210695 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.212538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:15.212538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-931755b1-7943-4ef9-b3ee-9dfc2e005f6a tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 404 len: 111 microversion: 2.1 time: 0.028597 Jun 15 10:30:15.212538 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 728/1445] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:30:15 2022] DELETE /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:30:15.215871 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:15.216515 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: efa75463-37d9-41ab-a4bc-6e3b07aa318f] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:15.222490 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.222945 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.223706 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.224148 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.238211 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f HTTP/1.1 Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:30:15.239741 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.242133 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': 'efa75463-37d9-41ab-a4bc-6e3b07aa318f'} Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:15.243316 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. Jun 15 10:30:15.244882 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:15.246427 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance efa75463-37d9-41ab-a4bc-6e3b07aa318f could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:15.246427 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-fe5efe15-94b6-4527-87a7-0cb463738cef tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f" status: 404 len: 111 microversion: 2.1 time: 0.029967 Jun 15 10:30:15.246427 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 718/1446] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:15 2022] GET /compute/v2.1/servers/efa75463-37d9-41ab-a4bc-6e3b07aa318f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:30:16.374115 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:16.374644 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.compute.api [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117720) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:16.382036 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.382511 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.383280 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.383722 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG oslo_concurrency.lockutils [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.396707 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.wsgi [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: request: DELETE /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae HTTP/1.1 Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept: application/json Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Accept-Encoding: identity Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Connection: close Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Length: 0 Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Content-Type: application/json Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Host: 10.222.0.57 Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Openstack-System-Scope: None Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Id: None Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Domain-Name: None Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Identity-Status: Confirmed Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Is-Admin-Project: True Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Id: default Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Domain-Name: Default Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Role: member,reader Jun 15 10:30:16.398230 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Roles: member,reader Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Id: default Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Domain-Name: Default Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: method: > Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: exception: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.400939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: action_args: {'id': '2b0c2e15-868c-49a1-8464-4ef339043aae'} Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: {{(pid=117720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:16.401904 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.404259 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.406698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: DEBUG nova.api.openstack.wsgi [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. {{(pid=117720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:16.406698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO nova.api.openstack.requestlog [None req-49b3a8b2-cc56-447c-ba21-0e1fad893aae tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 404 len: 111 microversion: 2.1 time: 0.031185 Jun 15 10:30:16.406698 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: [pid: 117720|app: 0|req: 729/1447] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Jun 15 10:30:16 2022] DELETE /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:30:16.410887 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Calling method '>' {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:16.411491 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.compute.api [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] [instance: 2b0c2e15-868c-49a1-8464-4ef339043aae] Fetching instance by UUID {{(pid=117721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:16.417786 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.418227 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.419008 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.419440 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG oslo_concurrency.lockutils [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Lock "8150241a-a1e8-4d3b-89e1-e7326b204d0a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.432900 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.wsgi [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] HTTP exception thrown: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Request method failure captured: Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: request: GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae HTTP/1.1 Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept: application/json Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Accept-Encoding: identity Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Connection: close Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Length: 0 Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Content-Type: application/json Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Host: 10.222.0.57 Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Openstack-System-Scope: None Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: User-Agent: python-urllib3/1.26.9 Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Auth-Token: gAAAAABiqbLMy5xNhiK82pz0ekBOjszUAmpKB00L1l8ZTvFNa8FsIpK3aNT9drvvhFv6Uq6c9w5vlXZ-tZhkQz-jors4J8OAPdqxToHBuhLYbDVnbRQ1XpQy3hd2k-LDeSsnUVT9MumAm2upbK0kt3UXQz9EQc6MHM0PW2G9bYGfr7H2Gb-xqOg Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Id: None Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Domain-Name: None Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Identity-Status: Confirmed Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Is-Admin-Project: True Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Id: default Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Domain-Name: Default Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Role: member,reader Jun 15 10:30:16.434423 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Roles: member,reader Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_64d59f3545044033ab48f6253122fe64", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/64d59f3545044033ab48f6253122fe64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/64d59f3545044033ab48f6253122fe64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Id: 64d59f3545044033ab48f6253122fe64 Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183133968 Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Id: default Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Domain-Name: Default Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Id: 016f3ad72de247f991f1939a987a4ffb Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: X-User-Name: tempest-AttachVolumeNegativeTest-1183133968-project Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: method: > Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: exception: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.436094 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: action_args: {'id': '2b0c2e15-868c-49a1-8464-4ef339043aae'} Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: {{(pid=117721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:30:16.437218 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. Jun 15 10:30:16.438806 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: ERROR nova.api.openstack.wsgi Jun 15 10:30:16.440429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: DEBUG nova.api.openstack.wsgi [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] Returning 404 to user: Instance 2b0c2e15-868c-49a1-8464-4ef339043aae could not be found. {{(pid=117721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:30:16.440429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO nova.api.openstack.requestlog [None req-cb5b9b2a-9015-4387-8a6d-4c9b248119cc tempest-AttachVolumeNegativeTest-1183133968 tempest-AttachVolumeNegativeTest-1183133968-project] 10.222.0.57 "GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae" status: 404 len: 111 microversion: 2.1 time: 0.028788 Jun 15 10:30:16.440429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: [pid: 117721|app: 0|req: 719/1448] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:16 2022] GET /compute/v2.1/servers/2b0c2e15-868c-49a1-8464-4ef339043aae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:31:27.036829 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:31:27.037517 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Wed Jun 15 10:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:33:29.322113 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:33:29.322755 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Wed Jun 15 10:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:33:40.977457 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:33:40.978056 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Wed Jun 15 10:33:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:34:47.046069 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:34:47.046939 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Wed Jun 15 10:34:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:35:21.244910 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:35:21.245429 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Wed Jun 15 10:35:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:35:27.821965 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:35:27.822564 dv-cinder-830283-5-iscsi devstack@n-api.service[117720]: Wed Jun 15 10:35:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:35:42.311496 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:35:42.312095 dv-cinder-830283-5-iscsi devstack@n-api.service[117721]: Wed Jun 15 10:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!